-- Logs begin at Tue 2022-05-10 15:56:42 UTC, end at Tue 2022-05-10 17:08:55 UTC. -- May 10 16:33:04.014192 dv-cinder-835881-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 16:33:04.023647 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:33:04 2022] *** May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: nodename: dv-cinder-835881-10-iscsi May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: machine: x86_64 May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: clock source: unix May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: pcre jit disabled May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: detected number of CPU cores: 4 May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: current working directory: / May 10 16:33:04.024640 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: detected binary path: /usr/bin/uwsgi-core May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: your processes number limit is 47680 May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: your memory page size is 4096 bytes May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: detected max file descriptor number: 2048 May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: lock engine: pthread robust mutexes May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: thunder lock: enabled May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 16:33:04.025168 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:33:04.070476 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: Python main interpreter initialized at 0x55dbaa11c9c0 May 10 16:33:04.070476 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: python threads support enabled May 10 16:33:04.070476 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: your server socket listen backlog is limited to 100 connections May 10 16:33:04.070476 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: your mercy for graceful operations on workers is 90 seconds May 10 16:33:04.070864 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:33:04.070944 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: *** Operational MODE: preforking *** May 10 16:33:04.071179 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: *** uWSGI is running in multiple interpreter mode *** May 10 16:33:04.071179 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: spawned uWSGI master process (pid: 91901) May 10 16:33:04.071391 dv-cinder-835881-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 16:33:04.073346 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: spawned uWSGI worker 1 (pid: 91914, cores: 1) May 10 16:33:04.073346 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: spawned uWSGI worker 2 (pid: 91915, cores: 1) May 10 16:33:04.073346 dv-cinder-835881-10-iscsi devstack@keystone.service[91901]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:33:09.880747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:33:09.880747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: from cryptography.utils import int_from_bytes May 10 16:33:09.882076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:33:09.882076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: from cryptography.utils import int_from_bytes May 10 16:33:09.882887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:33:09.882887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: from cryptography.utils import int_from_bytes May 10 16:33:09.884236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:33:09.884236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: from cryptography.utils import int_from_bytes May 10 16:33:09.932217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:33:09.932424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:33:09.932618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] command line args: [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:33:09.932876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:33:09.933044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ================================================================================ {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:33:09.933268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:33:09.933355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] admin_token = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.933486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:33:09.933567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] config_dir = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.933634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] command line args: [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:33:09.933705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.933860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] config_source = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.933945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:33:09.934096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] debug = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.934184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ================================================================================ {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:33:09.934254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.934543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] admin_token = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.934543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] config_dir = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.934664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] config_source = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] debug = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.935977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_config_append = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.936931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_dir = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_file = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937570 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.937770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.938071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.938273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_config_append = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.938462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.938699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.938899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.939107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_dir = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.939272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.939466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_file = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.939665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.939892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.940103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.940333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.940514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.940707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.940845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941710 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.941964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.942971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] publish_errors = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.943798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] standard_threads = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] publish_errors = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.944914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] use_journal = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] use_json = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.945973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] use_stderr = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] use_syslog = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] standard_threads = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.946825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.946953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.947088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.947247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.947379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.947505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] use_journal = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.947695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.947839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] use_json = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.947839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] use_stderr = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.948094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.948223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] use_syslog = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.948383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.948522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:33:09.948650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.948785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.948919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.949904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.950036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.950164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.950300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.950926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.951920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.952943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.953979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.954905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.955685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.956942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.957981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.958882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.959016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.960323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.960502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.960697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.960893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.961127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.961328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.961528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.961695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.961889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.962081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.962316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.962482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.962675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.962868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.963072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.963265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.963493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.963661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.963888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.964060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.964253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.964479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.964714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.964880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.965797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.966077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.966820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.966954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.967862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.968967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.969746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.970815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.971873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.972960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973277 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.973940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.974876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.975926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.976920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.977964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.978930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.external = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.979974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.password = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] auth.token = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.980944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.external = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.981946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.password = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] auth.token = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.982891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.983943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.984942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.985991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.986908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.987953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.988801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.989933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.990915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.991831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.992965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.993740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.994921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.995976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.996911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.997812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.998916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:09.999887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.000972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.001904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.002953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.003885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.004935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005227 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.005905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.006865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.007967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.008983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.009946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.010917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.011878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.012873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.013593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.013593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.013903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.014881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.015922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.016948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] role.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] role.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.017934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.018886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.019990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] role.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.020987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] role.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.021958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.022910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.023870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.024874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.025955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.026938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.027898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.028033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.028169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.028334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.028490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.029190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.029394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.029609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.029832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.030895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.031879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.032875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.connection = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.033869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.034860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.035980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.036836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.connection = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.037946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038498 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.038770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.039978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.039978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.039978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.039978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:33:10.039978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:33:10.049483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.049713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.049937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.051371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.051604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.051830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.058671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.061902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.087919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.088157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.088444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.088678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.144170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.144493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.196546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.196823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.197459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.197697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.262471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.262755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.262912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.263965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.264229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.287866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288605 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.288892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.300489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.301056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.315071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.315354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.315503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.315794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.315964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.316960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.317211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.317431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.317647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 16:33:10.333436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.333635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:33:10.333949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.334115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.334256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:33:10.334392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:33:10.334546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.334683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.334818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.334965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 16:33:10.335105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.335241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.335376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.335520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.335520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.335789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.346658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.346932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.347194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.347282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.347468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.347557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.347737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.348021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.355555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.356134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.359538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.359806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.360194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.360304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.360501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.360587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.360777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.360925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.361829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.362833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.363099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.389455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.390504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.391084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.391362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.392147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.392451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.396708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.396936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.397210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.397785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.398061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.398337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.405339 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.405621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.406336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.406619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.410194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.410482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.410755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.411318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.411889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.412057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.412141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.412359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.412637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.412904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.413170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.431968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.432247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.433119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.433394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.436808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.438011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.440410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.440703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.441618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.441907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.445639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.446815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.449197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.450364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.453530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.453829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.454117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.454400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.454585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.454797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.454921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.455041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.455159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.455405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.455679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.455950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.474805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.475186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.475453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.475717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.476868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.477249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.477514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.477775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.483815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.485560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.485837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.485981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.487561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.487832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.488931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.489216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.489501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.489779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.490053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.490867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.491146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.491421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.491699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.491980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.503645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.503924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.504199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.504507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.504786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.505073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.505345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.505487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.505670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.505955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.506228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.506500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.506768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.507046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.523866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.525431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.527128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.529300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.535101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.535290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.535454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.535606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.535744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.535744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.535744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.536136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.536136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.536432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.542167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.543622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.543767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.545304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.546996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.547283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.547565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.547838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.548487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.549025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.549304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.549577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.557272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.557565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.557845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.559563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.560555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.560846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.566302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.566582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.566858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.567133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.567403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.567681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.567964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.568241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.568532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.568771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 16:33:10.568930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.569978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.570110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.570242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.570373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.570599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.570848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.571108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.574088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.574088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.574088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.574088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 16:33:10.609836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dbaa11c9c0 pid: 91914 (default app) May 10 16:33:10.612561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dbaa11c9c0 pid: 91915 (default app) May 10 16:33:10.613329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139ffc5-8fa9-4c7b-b59e-773910d93514 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:10.613623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139ffc5-8fa9-4c7b-b59e-773910d93514 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:10.613914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139ffc5-8fa9-4c7b-b59e-773910d93514 None None] PATH_INFO: `/v3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:10.618129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue May 10 16:33:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:18.694042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.694614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.694614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.698939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:18.704702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:18.705110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:18.705278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:18.736200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG oslo_db.sqlalchemy.engines [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:33:18.917826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG passlib.handlers.bcrypt [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91914) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 16:33:18.918248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG passlib.handlers.bcrypt [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91914) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 16:33:18.974291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:18.975871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:19.100289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 10 16:33:19.270102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:19.304398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG oslo_db.sqlalchemy.engines [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:33:19.429381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8e872-cec0-4c89-992c-9e1fc9f7cda6 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:19.433729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:19.434429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:19.434787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:19.435071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:19.443918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:19.496706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 16:33:19.497049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535833a-2b52-493d-8006-7a5e1f991461 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:19.507540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 10 16:33:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:33:19.513582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:19.527383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6a4a-6351-43f8-bbe3-167c7a2acf56 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:19.531919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:19.533057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:19.533344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:19.533619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] PATH_INFO: `/v3/projects/18061f9244ab48daafb61d27ac0a0610` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:19.535117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=18061f9244ab48daafb61d27ac0a0610)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:19.595192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 16:33:19.595533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a844-11a4-43c0-8775-94acd470b6e7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:19.600139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue May 10 16:33:19 2022] GET /identity/v3/projects/18061f9244ab48daafb61d27ac0a0610 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:21.789325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95691dc-84fc-47dc-8634-07d75ecdbf76 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.789825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95691dc-84fc-47dc-8634-07d75ecdbf76 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.789925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95691dc-84fc-47dc-8634-07d75ecdbf76 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.794572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:21.800473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.800892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.801033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.820961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:21.822464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:21.830191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 16:33:21.851882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95691dc-84fc-47dc-8634-07d75ecdbf76 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:21.864142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95691dc-84fc-47dc-8634-07d75ecdbf76 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:21.868437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:21.869063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.869351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.869633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.877495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:21.879314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871469f4-e3c6-4f42-ac31-2bf6aa34329b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:21.888452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue May 10 16:33:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:33:21.893634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:21.902253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e27966-f0f9-4868-ac58-1aab732ee8a3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:21.907084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:21.907932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:21.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:21.908509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:21.909874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:21.911694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17467a0c-32ce-4d49-8f93-cb7dee9f8844 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:21.913261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue May 10 16:33:21 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:24.174519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7fd3-83d9-479b-842e-e70537582f37 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.175058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7fd3-83d9-479b-842e-e70537582f37 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.175193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff7fd3-83d9-479b-842e-e70537582f37 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.176605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:24.181659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.182042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.182220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.258724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba9a2e-7b94-4b6b-84fb-b6f5acc92478 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.259014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba9a2e-7b94-4b6b-84fb-b6f5acc92478 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.259295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba9a2e-7b94-4b6b-84fb-b6f5acc92478 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.260712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:24.267707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.267999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.268316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.308083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:24.309312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:24.311122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG passlib.handlers.bcrypt [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91915) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 16:33:24.311564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG passlib.handlers.bcrypt [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91915) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 16:33:24.359186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:24.360790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:24.385956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:24.409790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.460987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:24.482691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.507013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998df24-83ff-476c-9de7-a6c935260f33 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.539654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.540471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.540758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.541032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.552376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:24.563898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:24.565007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:24.565814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:24.570859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.580659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde08ab-6cd3-4314-9b6b-b45d3406cfe4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.612499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.613383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.613674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.613955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.663502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b0bf-39a3-44b7-8fab-7ef33d28b377 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.677995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.679510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.695732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.696419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.696701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.696973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.697718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:24.698023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.699394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.710704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:24.716443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.770932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:33:24.776337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.810794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc20c4-1eb5-4f50-b84b-d7993df03272 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.841737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.842599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.842885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.843162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.844391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.845860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.847625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:24.852826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:24.870561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931e506-4df6-4706-b82d-4b0c5b4ac5e0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.902632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.903503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.903729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.904012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.949634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866ff7-3f8d-47ac-be47-9c56bd21a235 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:24.984614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:24.985341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:24.985630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:24.985910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:24.987153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:24.988672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:24.990336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:24.996554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:25.030188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:25.031662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:25.053101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:25.054119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:25.054919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:25.054919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:25.054919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:25.054919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:25.054919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:25.060031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:25.093981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f3b96-b2f4-4f74-a7bc-b91c64f5998a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:25.126256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:25.126904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:25.127192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:25.127471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:25.128344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.domain.id=default, user.id=2e2d8842c7d74786b278cdcd7a3dd77d) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:25.130346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:25.131154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94550-2ec3-43e0-87a5-642e1aaaf403 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:25.152308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 10 16:33:24 2022] GET /identity/v3/role_assignments?user.id=2e2d8842c7d74786b278cdcd7a3dd77d&scope.domain.id=default&role.id=1b495dbb303447258ed6e7db6e67280f => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:25.157248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0792ca-2755-4921-ac95-55097e6ed06e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:25.193222 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:25.194042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:25.194334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:25.194618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:25.195378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:25.195690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:25.197195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f7c6b-7596-4f00-8a58-0c0732caba86 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:25.217512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:27.861143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0ced-53ee-4262-be17-ac8dea470250 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.862185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0ced-53ee-4262-be17-ac8dea470250 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.862672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0ced-53ee-4262-be17-ac8dea470250 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.864320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:27.880540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352250a-3010-40df-98d8-1fee7534d4ce None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:27.881446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352250a-3010-40df-98d8-1fee7534d4ce None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:27.881985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352250a-3010-40df-98d8-1fee7534d4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:27.906024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3352250a-3010-40df-98d8-1fee7534d4ce None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:27.907734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3352250a-3010-40df-98d8-1fee7534d4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:28.009551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:28.046954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0ced-53ee-4262-be17-ac8dea470250 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.174401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631723a9-de4f-4c22-a59e-9989088115c2 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.175047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631723a9-de4f-4c22-a59e-9989088115c2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.175556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631723a9-de4f-4c22-a59e-9989088115c2 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.177408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:28.182096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.182601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.183079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.189538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0ced-53ee-4262-be17-ac8dea470250 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.212897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:28.214423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:28.238690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.239840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.240374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.242281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.264790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:28.274509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b87afd7b-a8b4-49e5-985b-8b211ddd1ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:33:28.308098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:28.309003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:28.310341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:33:28.310341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:33:28.310341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:33:28.310341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:28.312239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:28.313684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561a4ab-796f-4021-a31a-9c2aaa4c43a2 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.314163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561a4ab-796f-4021-a31a-9c2aaa4c43a2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.314629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561a4ab-796f-4021-a31a-9c2aaa4c43a2 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.316361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 14/26] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:28.326424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003668-9625-449c-bf28-b5549acb839c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.326935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003668-9625-449c-bf28-b5549acb839c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.327385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7003668-9625-449c-bf28-b5549acb839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.350990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:28.351951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.352759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c7003668-9625-449c-bf28-b5549acb839c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:28.354126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c7003668-9625-449c-bf28-b5549acb839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:28.451421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:28.452707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7003668-9625-449c-bf28-b5549acb839c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.471735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a9aed-e237-498e-ac98-d3e6b6e3cc6b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.521804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.522872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.523360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.523850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.524814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:28.525321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:28.527078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:28.554310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 14/29] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:28.555497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.605101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7003668-9625-449c-bf28-b5549acb839c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.670035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.670724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.671010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.671285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.672040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:28.672249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c01cf5-879d-4f52-832e-eaeb0cb31742 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.673479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afb5c4-2c8b-4e4d-ad3a-b578e1a67b4f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:28.711651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.712856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.713343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.713818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.726672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:28.736790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:28.737613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:28.738403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:28.740815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:28.742069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.803011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 16/31] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 10 16:33:28 2022] POST /identity/v3/roles => generated 219 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:28.804668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9aef-1dfd-49b5-852f-466ce0c46579 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.804965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9aef-1dfd-49b5-852f-466ce0c46579 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.805245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a9aef-1dfd-49b5-852f-466ce0c46579 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.806516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 17/32] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:28.807226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a9aef-1dfd-49b5-852f-466ce0c46579 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:28.881226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb838aa-cc52-4e0d-a33c-78e0a1cae687 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.942268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.943365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.944163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.944737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.945997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:28.947823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:28.952725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a9aef-1dfd-49b5-852f-466ce0c46579 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:28.991923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:28.992646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:28.992937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:28.993223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:28.994160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:28.994544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:28.996174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13fd96-e070-42e0-bd87-bb904cd037b8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.007261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 18/33] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:29.008827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.009128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.009410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.039797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:29.041391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:29.114089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:29.115411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:29.133001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 16/35] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:33:28 2022] POST /identity/v3/projects => generated 301 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:29.149575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:29.230202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2813fe-d56a-42c2-9d2b-b6fc0199fa29 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:29.283390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:29.284231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.284555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.284837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.286349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:29.287872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.291930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 20/36] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:29 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:29.300264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:29.390398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4edc9-b017-4e87-8c74-b80438216251 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:29.442489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:29.443190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.443567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.443856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.444678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:29.446241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb80a4e-d30e-4d3c-8fc6-00312a0cee0f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.452534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114a5b4-d72f-4c25-aa51-b26bc476a4c0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:29.468794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 17/37] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 10 16:33:29 2022] POST /identity/v3/roles => generated 225 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:29.470617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724276c-4e37-4c50-af97-8c6aafe77175 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.471166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724276c-4e37-4c50-af97-8c6aafe77175 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.471677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724276c-4e37-4c50-af97-8c6aafe77175 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.473262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:29.479410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.480435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.483051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.505754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:29.506680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.507142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.507489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.508875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:29.509002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:29.510564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.511246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:29.513375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 21/39] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:29.518196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:29.607852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:29.631289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:29.652420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57524e-4a46-4460-9f05-0dc5fd57e8ad None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:29.693582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:29.694056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.695654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.695654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] PATH_INFO: `/v3/domains/default/users/2e2d8842c7d74786b278cdcd7a3dd77d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.696992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2e2d8842c7d74786b278cdcd7a3dd77d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:29.698403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a21fe-b781-45a2-b22f-c2138a235492 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.720540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1361 bytes} [Tue May 10 16:33:29 2022] PUT /identity/v3/domains/default/users/2e2d8842c7d74786b278cdcd7a3dd77d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:33:29.753531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87947b4d-3a6c-4148-86f0-3b87fc22ea2d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:29.792475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:29.793209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.793555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.793922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.795401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:29.796869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de56d2a-ced5-4445-9151-a8c3c6136939 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:29.813688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 10 16:33:29 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:29.842585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef075014-ee52-4e83-9cad-0b33db2c54a0 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.842880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef075014-ee52-4e83-9cad-0b33db2c54a0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.843074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef075014-ee52-4e83-9cad-0b33db2c54a0 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.844624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 23/43] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:29.854629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:29.854629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:29.854629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:29.893082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:29.894097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:29.996971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:30.020993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef075014-ee52-4e83-9cad-0b33db2c54a0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.133313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef075014-ee52-4e83-9cad-0b33db2c54a0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.166646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.167448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.167743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.168023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.170389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:30.171866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22874032-2ff9-4041-90c8-57fee24d3dc9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:30.173713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 24/45] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:30.179448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:30.276902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f44b75-4bb9-4db3-b9ca-9133b2da6bbf None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:30.311191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:30.311856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:30.312150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:30.312474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:30.313188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:30.314662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebaf2e-1314-458a-889f-d775a7d642e7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:30.340783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:33:30 2022] POST /identity/v3/projects => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:32.012192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97e4f-f0e3-407b-b296-8173caf43900 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.012828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97e4f-f0e3-407b-b296-8173caf43900 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.012828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97e4f-f0e3-407b-b296-8173caf43900 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.014210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:32.019420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.019823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.020066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.036971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:32.038145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:32.101760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:32.125231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97e4f-f0e3-407b-b296-8173caf43900 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.219756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97e4f-f0e3-407b-b296-8173caf43900 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.270305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.271474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.271592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.271905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.284569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:32.292102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:32.293113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:32.294007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:32.299437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.394561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f86dd2-a47d-4f81-8220-12020d656452 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.428696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.429343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.429631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.429906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.430656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:32.430964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.432368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa1757-629d-46ab-a664-ef290e453963 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.444012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 24/50] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:32.449381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.551206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20855983-36d1-4269-bfb8-39f432e311a3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.565429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba57a7-a0ee-4387-9d5d-d8731e5159be None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.565727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba57a7-a0ee-4387-9d5d-d8731e5159be None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.566012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba57a7-a0ee-4387-9d5d-d8731e5159be None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.567388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 25/51] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:32.572367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.572881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.573375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.585400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.586274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.586560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.586839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.588031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.589614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.590344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:32.591265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:32.591688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:32.596497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.654573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 26/53] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:32.677920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.690899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea289f-9134-40de-82b9-3e11f6b86e91 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.722904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.723710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.724000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.724297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.725478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.726961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.728599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:32.734930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.769338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc6f34-330b-4dd6-90cd-7c4bb09c26f4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.801303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.802019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.802304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.802580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.803751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.805251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.807031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:32.812862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:32.827382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5e35d-cae7-41e6-9a1f-8416e6d8eb39 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.858688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.859339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.859627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.859905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.860798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.domain.id=default, user.id=2e2d8842c7d74786b278cdcd7a3dd77d) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:32.861142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.862608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4631455-9a77-4884-9e4f-dfc6e3389282 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.868658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1322 bytes} [Tue May 10 16:33:32 2022] GET /identity/v3/role_assignments?user.id=2e2d8842c7d74786b278cdcd7a3dd77d&scope.domain.id=default&role.id=1b495dbb303447258ed6e7db6e67280f => generated 530 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:32.908922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f4aa-2ff6-40e3-b97e-951e4234bbbd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:32.944916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:32.945591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:32.945876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:32.946153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:32.946880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:32.948399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b728558-5c65-4c8f-8094-e07b50a924e2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:32.975241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 10 16:33:32 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:33:35.192571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1120-73dd-4e82-bd08-5ab1b69c140d None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:35.193084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1120-73dd-4e82-bd08-5ab1b69c140d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:35.193193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c1120-73dd-4e82-bd08-5ab1b69c140d None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:35.194508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:35.199638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:35.200072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:35.200410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:35.217565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:35.218744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:35.280105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:35.304873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c1120-73dd-4e82-bd08-5ab1b69c140d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:35.399736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c1120-73dd-4e82-bd08-5ab1b69c140d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:35.431206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:35.431978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:35.432264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:35.432571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:35.433728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:35.435821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa3cd8-c1f9-443f-bd4c-941a677a82b0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:35.437435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:35.442925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:35.536800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d61fb-3796-4b19-8824-deb61037aeb5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:35.569487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:35.570147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:35.570431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:35.570706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:35.571400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:35.573297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a65a3-81be-4a78-b2b5-af8991b2625d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:35.600044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:33:35 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:39.074011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750269-0b58-44cc-9004-9a9bcb9f3279 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.075600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750269-0b58-44cc-9004-9a9bcb9f3279 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.076108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750269-0b58-44cc-9004-9a9bcb9f3279 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.077723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:39.083502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23244-eb98-48cb-a788-fe067fbb18db None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.084446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23244-eb98-48cb-a788-fe067fbb18db None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.084938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d23244-eb98-48cb-a788-fe067fbb18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.104065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-39d23244-eb98-48cb-a788-fe067fbb18db None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:39.105593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-39d23244-eb98-48cb-a788-fe067fbb18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:39.183350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddecb-2a52-4e39-9aa7-0bca38772cfe None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.184911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddecb-2a52-4e39-9aa7-0bca38772cfe None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.185726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbddecb-2a52-4e39-9aa7-0bca38772cfe None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.187950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 33/63] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:39.193616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.194146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.194662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.216473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:39.217994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:39.218097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 31/64] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:39.219405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df41e5-e6fb-40ac-bd45-36fb4608223e None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.219698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df41e5-e6fb-40ac-bd45-36fb4608223e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.219987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df41e5-e6fb-40ac-bd45-36fb4608223e None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.221289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 32/65] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:39.229911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.230209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.230497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.256116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:39.257350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:39.312384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:39.313303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.340539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:39.351152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.427045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840061e-50e4-4bf7-b243-00c2bc7f226e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.459494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e007b-ad37-4e20-96d2-658ea6b7bb34 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.464850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.466489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.466925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.467363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.479322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:39.488353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:39.489497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:39.490444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:39.492493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:39.493534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.501365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.502165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.502510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.502790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.513567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-2cb6faaf-aee2-46ba-87bc-935c3cca9dd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:39.521133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:39.521956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:39.525831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704936-fe30-42b5-82f3-965bf123ca9f None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.526510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704936-fe30-42b5-82f3-965bf123ca9f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.526510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06704936-fe30-42b5-82f3-965bf123ca9f None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.526510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 35/70] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:39.526510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704936-fe30-42b5-82f3-965bf123ca9f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.599486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17788-4c67-48c0-9e23-550cda63bde2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.631934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06704936-fe30-42b5-82f3-965bf123ca9f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.632465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.633280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.633567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.633844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.644332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:39.652326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:39.653343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:39.654124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 36/71] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:39.655298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.666527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.667202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.667489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.667775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.669103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:39.669409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:39.670927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f99aa3-cb9e-4cf0-9dd4-c936f5095a8b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:39.679559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:39.680837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df960-f3da-4cab-adb2-444ce65cb5f1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.681131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df960-f3da-4cab-adb2-444ce65cb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.681412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3df960-f3da-4cab-adb2-444ce65cb5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.697027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6e3df960-f3da-4cab-adb2-444ce65cb5f1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:39.698239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6e3df960-f3da-4cab-adb2-444ce65cb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:39.748135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953a19-ab49-440e-9907-168ef840ce0e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.761025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 37/73] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:39.764235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed548e-9f43-4c8d-b04e-9a3797956a02 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.764559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed548e-9f43-4c8d-b04e-9a3797956a02 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.764841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed548e-9f43-4c8d-b04e-9a3797956a02 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.766255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 38/74] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:39.766813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed548e-9f43-4c8d-b04e-9a3797956a02 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.782521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.783192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.783484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.783773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.784579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:39.784889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:39.786292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:39.794900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:39.795692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.867521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed548e-9f43-4c8d-b04e-9a3797956a02 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.888046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de5ef-c7a3-42b2-9710-4beec25ac7e7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:39.899062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.899724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.900012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.900310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.901064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:39.901375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:39.902770 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb97d6-9cdd-4a19-8976-6895622e6bb9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:39.911130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:39.912602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1818-611e-4e0f-808a-75da01165089 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.912772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1818-611e-4e0f-808a-75da01165089 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.913498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c1818-611e-4e0f-808a-75da01165089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.921532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:39.922395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:39.922680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:39.922952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:39.929276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-556c1818-611e-4e0f-808a-75da01165089 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:39.930441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-556c1818-611e-4e0f-808a-75da01165089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:39.936094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:39.937571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:39.939218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 38/77] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:39.939968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:39.995267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:39.997745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1818-611e-4e0f-808a-75da01165089 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.037927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0920f9f-e404-4dcc-886c-ee426d483ad8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.069917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.070704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.070994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.071278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.080929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:40.088521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:40.089348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:40.090218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 39/79] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:40.091371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c1818-611e-4e0f-808a-75da01165089 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.091715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.123488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.124300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.124607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.124885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.126279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.127707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.129516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:39 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:40.130178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.189271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c23602-7b6a-44b8-a17d-443a8e4e5971 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.220476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.221338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.221574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59219c-9360-4b58-865a-edbd99277445 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.221668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.221880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.223069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.224561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.226166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:40.230640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.254789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.255437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.255727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.256008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.317465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bcbc-05bd-4d11-b8e0-41f32c13c235 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.319742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.321242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.348656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.349432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.349723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.349999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.351162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.352611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.354201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:40.359302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.421217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 42/83] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:40.421217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.460118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6615-3d45-40d5-9e8e-70e541422e59 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.491729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.492435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.492723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.493001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.493742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:40.494052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.495434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.503858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:40.504714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.506326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6ab0e-b24e-48ca-8291-c527448ae149 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.539234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.539887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.540176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.540494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.597427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ac28f-5c60-4843-96f2-54ac40528037 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.605677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.608122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.629132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.629777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.630065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.630356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.693040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.694458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.701121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:40.701941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.787303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:40.792550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.792998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72dba9-230f-46aa-86d3-c2421106bfb9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.827099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.827763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.828050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.828358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.829076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.830524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.849492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 44/87] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:33:40 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:40.864497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.907312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bad802-638e-4e97-9188-b0883b8bf29a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:40.947377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:40.948171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:40.948483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:40.948767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:40.950734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:40.952301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:40.954120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:40.957246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:40.973252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d8158-023c-4f9f-9d93-eaa914787b24 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.009069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.009965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.010255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.010537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.011806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.013928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.019999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.019999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.060631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940385-1aea-41e0-8d15-58cd58048d20 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.097100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.098002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.098291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.099433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.100083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.101639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.103494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:40 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.108386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.118872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6456a9-23dd-4d95-acd2-ad57d54010b7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.155092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.156334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.156765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.157186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.158565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.160187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.162122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.163098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.207536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb5d9c-08e9-4f0f-8a19-c22a44bc9984 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.244921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.245746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.246131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.246507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.248045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:41.248475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.250292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.255857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=752329c75e7648f4a9c9d02695370fab => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.257872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.279692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e20b9-2c35-400e-93d4-60b495ee69d4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.316663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.317586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.318180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.318803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.366964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee238dc-2e92-4e91-bddf-3355d31fe63f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.391497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.393306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.406411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.407242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.407638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.408022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.409087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=2e2d8842c7d74786b278cdcd7a3dd77d) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:41.409421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.410994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.417042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/role_assignments?user.id=2e2d8842c7d74786b278cdcd7a3dd77d&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.418062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.503533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 47/94] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:41.509596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.533340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb76766-a4e7-41bf-b652-81004af3ceb0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.573075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.573959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.574355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.575094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.576496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:41.576924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.578624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 48/95] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.645333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7b9ea-8beb-4f22-9801-98f9ba3efed1 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.687182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.688424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.688877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.689320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] PATH_INFO: `/v3/projects/0f5d9651373c47ab9705e7180b3dd216` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.690884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d9651373c47ab9705e7180b3dd216)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.692631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b92ac-8966-4e90-aa1d-5fff7dd840aa None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.695109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/projects/0f5d9651373c47ab9705e7180b3dd216 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:41.701234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:41.841751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a195c2-dfc4-4aac-bbca-2e5380285a69 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:41.875867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:41.876569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:41.876858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:41.877140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:41.877981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0f5d9651373c47ab9705e7180b3dd216, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:41.878301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:41.879766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badab7ce-ccb3-4756-86a5-ee86e3432f0c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:41.885805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:41 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=0f5d9651373c47ab9705e7180b3dd216&role.id=752329c75e7648f4a9c9d02695370fab => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:43.937975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbab43-1701-4f3d-a523-0d68a3f402e8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:43.938522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbab43-1701-4f3d-a523-0d68a3f402e8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:43.938522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbab43-1701-4f3d-a523-0d68a3f402e8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:43.939904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:43.953847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:43.954355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:43.954436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:43.976490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:43.977698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:44.058872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:44.097771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbab43-1701-4f3d-a523-0d68a3f402e8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.226040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbab43-1701-4f3d-a523-0d68a3f402e8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.267720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.268943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.269446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.269929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.285367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:44.293925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:44.294955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:44.295743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:44.302268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 50/100] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:44.309020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.430209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed2dc-5fdb-4af3-a385-be76be29be5a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.468689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.469392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.469676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.469953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.470733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:44.471040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.472559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.482530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:44.488257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.666638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8025eb-8b05-459a-a4c0-21a672892b3f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.718181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.719227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.719522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.719808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] PATH_INFO: `/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.739380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] RBAC: Authorizing `identity:get_user(user_id=c89ccb3dd9424d1bb9be1bcffc77a724)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.741446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d774a-9dd9-4b25-ab23-c42fd097ab97 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.743815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724 => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:44.751101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:44.856813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d104e71-0f68-44d5-b812-053f3daeb2e7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:44.869895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a57ffa-a831-4948-8f73-0dfbe23b33a8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.870437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a57ffa-a831-4948-8f73-0dfbe23b33a8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.870870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a57ffa-a831-4948-8f73-0dfbe23b33a8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.881146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 52/103] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:44.886778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d055e7-1684-416f-801c-ee5d5e57be45 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.887913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d055e7-1684-416f-801c-ee5d5e57be45 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.888458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d055e7-1684-416f-801c-ee5d5e57be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.896704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:44.897660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.898923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.899419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.910969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-31d055e7-1684-416f-801c-ee5d5e57be45 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:44.912576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-31d055e7-1684-416f-801c-ee5d5e57be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:44.982833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:44.988800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:44.988800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657ab87-ca80-4ad0-aa90-ab179bcd5401 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:44.990937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485733e-04cb-40b8-8497-2661db96bbe0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.991444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485733e-04cb-40b8-8497-2661db96bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.991926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485733e-04cb-40b8-8497-2661db96bbe0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:44.993530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 54/105] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:44.994934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620574-b1bc-4a62-9c54-110736228dd1 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:44.995424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620574-b1bc-4a62-9c54-110736228dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:44.999235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad620574-b1bc-4a62-9c54-110736228dd1 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.001093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 55/106] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:45.002642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.003163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.003641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.036828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:45.038791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:45.102776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 52/107] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:45.102776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.102776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.102776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.120836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:45.122096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:45.122217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 56/108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:45.123368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.214797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 53/109] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:45.216207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.232385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8607a-bbb1-4986-9d26-6066c98e3702 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.268163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.268907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.269192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.269466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.279988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:45.287698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:45.295173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 57/110] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:45.295983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.312905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4817a-58e6-44ff-ac3c-e75ee8e858a8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.345407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367143cb-f895-4c54-b165-75126975a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.346263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367143cb-f895-4c54-b165-75126975a33e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.346548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367143cb-f895-4c54-b165-75126975a33e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.346820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367143cb-f895-4c54-b165-75126975a33e None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.348004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367143cb-f895-4c54-b165-75126975a33e None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.349496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367143cb-f895-4c54-b165-75126975a33e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.351183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:45.356259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ea13-9916-4e40-8d82-584891286413 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.356259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ea13-9916-4e40-8d82-584891286413 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.356259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553ea13-9916-4e40-8d82-584891286413 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.356259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 55/112] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:45.356259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553ea13-9916-4e40-8d82-584891286413 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.397836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddae68-9fff-4ff1-8b04-7a34a2720a94 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.430365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.431154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.431442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.431724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.432914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.435377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.437070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 58/113] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:45.437823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.462767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553ea13-9916-4e40-8d82-584891286413 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.494430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.495209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.495493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.495769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.505758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0c9c0da1-82d7-41b2-9867-741fa1d51cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:45.514027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:45.515041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:45.515776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:45.516784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 56/114] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:45.517705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da514bd-5f3e-4bca-8c21-6df0aa23cd95 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.518056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da514bd-5f3e-4bca-8c21-6df0aa23cd95 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.518400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da514bd-5f3e-4bca-8c21-6df0aa23cd95 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.519692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 57/115] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:45.520815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da514bd-5f3e-4bca-8c21-6df0aa23cd95 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.536865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a8787-844c-48c7-afb8-ead1fdb29195 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.569778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.570440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.570731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.571013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.571803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:45.572117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.573541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4cd00-a006-4e44-a7c2-f3e4ab24b183 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.582536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 59/116] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:45.583747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.584036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.584348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.600894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:45.602105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:45.621159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da514bd-5f3e-4bca-8c21-6df0aa23cd95 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.654014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.654664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.654955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.655234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.656068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=c89ccb3dd9424d1bb9be1bcffc77a724) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:45.656420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.657891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.663065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 58/117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/role_assignments?user.id=c89ccb3dd9424d1bb9be1bcffc77a724&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:45.663897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:45.665412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.665623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.778443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20a223-3d81-45be-b0c2-4176a09c4123 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.781451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedb8cb-4a2f-471d-be1e-4d160e857106 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:45.814647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853be1-0750-4881-95c7-172415723cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.815322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853be1-0750-4881-95c7-172415723cac None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.815674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853be1-0750-4881-95c7-172415723cac None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.815877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853be1-0750-4881-95c7-172415723cac None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.816630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c853be1-0750-4881-95c7-172415723cac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.817590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:45.818182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c853be1-0750-4881-95c7-172415723cac None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.818280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.818540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.818814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.819585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:45.819893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:45.821391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ddb8e-2b56-42a6-81cd-3742280d8660 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:45.835482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 61/119] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:45.835482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:45.835482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:45.835482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:45.851246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:45.852792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:45.857887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 59/120] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:33:45 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:45.858752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853be1-0750-4881-95c7-172415723cac None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.952233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 62/121] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:45.953540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:45.983394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853be1-0750-4881-95c7-172415723cac None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.027453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.029789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.030291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.030766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.033237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.035021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.037016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 60/122] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.038123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.064876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062977b1-f69e-4c51-af77-49a8bcd12f68 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.101825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.102656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.102939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.103211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.116371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:46.125392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:46.126275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:46.127017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:46.131472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 63/123] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:46.132356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.146457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07c340-7967-4d5e-b475-58b199e45f9a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.181121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.182356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.182849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.183366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.185330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.187021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.189197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 61/124] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.190194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.232288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daee07-acc8-47e3-bca5-0151e2ec671f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.265665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.266897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.266897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.267061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.277531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:46.286220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:46.287081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:46.287837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:46.292256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 64/125] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:46.293127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.295789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79950881-01cc-43fb-b2ef-84cce9153372 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.329731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.330913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.331375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.331830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.333222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.334851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.337073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 62/126] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.337999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.396485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a061-d1ce-4b40-a6d8-109caac7f14e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.430977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.431751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.432077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.432492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.433323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:46.433694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.436195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.440022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1e0c-114e-42bd-a421-1bc37ffcac21 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.448656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 65/127] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.450526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.475267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.476481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.476941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.477433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.478817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.480506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.483321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.484303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.555032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03c45-4e36-43cf-8ebe-fd0e27f39a3e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.587045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acb102-8bc9-4a3c-ae39-650601fc58d3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.590641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.591309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.591597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.591877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.592675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:46.592986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.594358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.607583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.608497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.623681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.624927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.625426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.625896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/a7bb3edff26f4939966d2db53dd69061/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.628077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, user_id=a7bb3edff26f4939966d2db53dd69061, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.629783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.646903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 64/130] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:46 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/a7bb3edff26f4939966d2db53dd69061/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:46.648005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.714703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c59c6-75bd-4ab4-b6d8-de8b79a75dbd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.751316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.752265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.752678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.752964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.754417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.756081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.758234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 67/131] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.759134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.777758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7d2a8-9145-4b4e-8e28-a2f7ff6c35da None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.828210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.830785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.831076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.831415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/2e2d8842c7d74786b278cdcd7a3dd77d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.838422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, user_id=2e2d8842c7d74786b278cdcd7a3dd77d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.840004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.883697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 65/132] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:46 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/2e2d8842c7d74786b278cdcd7a3dd77d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:46.884578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:46.936541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0d8bd-59b7-4a0c-9fae-f836a55a7c0b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:46.975445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:46.976357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:46.976643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:46.976920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:46.978138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:46.979686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:46.981380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 68/133] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:46.990201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.050339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eb90-d735-41ef-a134-41e7f638caf0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.091482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.092138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.092463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.092748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] PATH_INFO: `/v3/projects/0f5d9651373c47ab9705e7180b3dd216` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.094058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d9651373c47ab9705e7180b3dd216)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.095547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.097561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 66/134] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/projects/0f5d9651373c47ab9705e7180b3dd216 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:47.104103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.214476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d86ef2-3ae7-47c2-8162-b4f88475c2ab None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.217320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147bca9-8f85-4fa8-9676-fc413fe6057b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.249079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.250027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.250309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.250586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] PATH_INFO: `/v3/projects/0f5d9651373c47ab9705e7180b3dd216/users/a7bb3edff26f4939966d2db53dd69061/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.252635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f5d9651373c47ab9705e7180b3dd216, user_id=a7bb3edff26f4939966d2db53dd69061, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.254108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.266783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.268439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.270992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.272320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.275617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 67/135] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:47 2022] PUT /identity/v3/projects/0f5d9651373c47ab9705e7180b3dd216/users/a7bb3edff26f4939966d2db53dd69061/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:47.281286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.282843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733d1ac-fe78-4a25-96af-935c6d6ed128 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.285152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 69/136] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:46 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:47.290768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:47.410200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124265-33ae-447d-b906-79a71a8e2264 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:47.447999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:47.448929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:47.449209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:47.450077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/a7bb3edff26f4939966d2db53dd69061/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:47.452363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, user_id=a7bb3edff26f4939966d2db53dd69061, role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:47.453902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228b62-54ca-407d-9016-3c3c0a469211 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:47.480622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:47 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/a7bb3edff26f4939966d2db53dd69061/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:48.347953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3d85-91b2-4f3d-a048-035bfd7f8d4e None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:48.348515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3d85-91b2-4f3d-a048-035bfd7f8d4e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:48.348515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb3d85-91b2-4f3d-a048-035bfd7f8d4e None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:48.350179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:48.355091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:48.355494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:48.355679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:48.373346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:48.374488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:48.444335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:48.478732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3d85-91b2-4f3d-a048-035bfd7f8d4e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:48.616952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb3d85-91b2-4f3d-a048-035bfd7f8d4e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:48.660979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:48.662165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:48.662666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:48.663138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:48.674640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:48.682553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:48.683399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:48.684762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:48.691880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:48.697382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:48.807991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9363e64-c4e4-419f-82a6-cf957da98fdd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:48.849864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:48.850546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:48.850832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:48.851111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:48.851867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:48.852174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:48.853585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:48.862637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 70/141] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:48.868551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:49.013941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d823b1a-07b5-42c6-b7ac-d05f1e9f4b89 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:49.060967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:49.062242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.062727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.063202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] PATH_INFO: `/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.064660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c89ccb3dd9424d1bb9be1bcffc77a724)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:49.066322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:49.068167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:48 2022] GET /identity/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:49.073855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:49.203253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860f62e-81e1-4b37-9274-0949a036da65 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:49.239634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:49.240526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.240810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.241085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.242273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:49.243725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26fffc-606a-4990-9d4e-c4a86d70e3c1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:49.245745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 71/143] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:49 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:49.252200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:49.329988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15936d6-ad9a-4010-b15c-a1bfa7282e0e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.330289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15936d6-ad9a-4010-b15c-a1bfa7282e0e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.330557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15936d6-ad9a-4010-b15c-a1bfa7282e0e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.332159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 72/144] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:49.346544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.346827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.347113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.367848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:49.376542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:49.442769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd833-3e80-41c7-9878-96b3014ee1d2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:49.467709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 73/145] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:49.482334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:49.483229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.483516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.483791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/c89ccb3dd9424d1bb9be1bcffc77a724/roles/1464e5118cb541829ef3997b1b11b6c9` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.485816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, user_id=c89ccb3dd9424d1bb9be1bcffc77a724, role_id=1464e5118cb541829ef3997b1b11b6c9)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:49.487365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:49.504024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:49.505311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 73/146] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:49 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/users/c89ccb3dd9424d1bb9be1bcffc77a724/roles/1464e5118cb541829ef3997b1b11b6c9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:49.619549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe426f-4021-4b1c-bc17-9e85ceecb43a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:49.659903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:49.660750 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.661031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.661299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.662478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:49.663948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8617c7-e75a-4897-95a9-7b140568ab33 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:49.665900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:49.671905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:49.803366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9045-73f4-4f06-9399-ae8e27cd1d96 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:49.838960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:49.839900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:49.840404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:49.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:49.841892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:49.843558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf98a8b-2a9f-4e43-a792-8a017b483dbc None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:49.869745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 74/148] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:33:49 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:33:50.114283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c99-f8f3-4034-82ce-d9166a66cc03 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.114961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c99-f8f3-4034-82ce-d9166a66cc03 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.115468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64c99-f8f3-4034-82ce-d9166a66cc03 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.117149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 75/149] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:50.123605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.123893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.124361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.149352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:50.150786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:50.221516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 75/150] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:50.269826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e64c99-f8f3-4034-82ce-d9166a66cc03 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.393906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e64c99-f8f3-4034-82ce-d9166a66cc03 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.431531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.432386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.432678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.432956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.443486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:50.454150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:50.455018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:50.455776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:50.456380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 76/151] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:50.461497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.576535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c30d-8b53-4de3-a7ff-06ea571c6896 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.613741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.614434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.614771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.615053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.615826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:50.616140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:50.617622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7eeb-4f8d-48d2-8553-22ecdb9bd6cf None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:50.628195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 76/152] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:50.634327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.664373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae925f3-3bf9-426a-8274-dad09294738c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.664373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae925f3-3bf9-426a-8274-dad09294738c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.664373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae925f3-3bf9-426a-8274-dad09294738c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.664373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 77/153] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:50.666418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020707-d24b-4e09-ba24-ace5b4cc3b54 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.666714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020707-d24b-4e09-ba24-ace5b4cc3b54 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.666998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020707-d24b-4e09-ba24-ace5b4cc3b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.697599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-30020707-d24b-4e09-ba24-ace5b4cc3b54 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:50.698790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-30020707-d24b-4e09-ba24-ace5b4cc3b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:50.825831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1b15-2cd0-4644-93a8-53e5ba283608 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:50.834097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:50.863245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e0ab-ee57-41d1-a149-57c041dc9fc3 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.863551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e0ab-ee57-41d1-a149-57c041dc9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.863806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e0ab-ee57-41d1-a149-57c041dc9fc3 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.865265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 79/155] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:50.868053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:50.868993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.869275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.871022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:50.871860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:50.872407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.874549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] PATH_INFO: `/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:50.876935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] RBAC: Authorizing `identity:get_user(user_id=2e2d8842c7d74786b278cdcd7a3dd77d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:50.878428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:50.880266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 77/156] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/users/2e2d8842c7d74786b278cdcd7a3dd77d => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:50.880964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.892459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:50.893656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:50.969381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 80/157] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:50.970238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:50.998631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c886a8e-b291-47a5-bfdc-b4cc58dd8227 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.047403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.048216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.048601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.048876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.073521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:51.073867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf079ff9-3dd1-46d1-8db3-2413d1ef204f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:51.089460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:51.090388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:51.091142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:51.091701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 78/158] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:51.092329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.115077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.115742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.116030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.116329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.224840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.227032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfcc2f-c2f5-491b-bca8-86b256996067 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.242756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd373d-e8a7-44b7-90a4-37c164c90498 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.289617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.291078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.291565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.292051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.307444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:51.318228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:51.319099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:51.320028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:51.321922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 79/159] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:51.322432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.354574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 81/160] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:51.357247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222163d0-5a14-49c6-b32c-da82c637182a None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.357991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222163d0-5a14-49c6-b32c-da82c637182a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.358443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222163d0-5a14-49c6-b32c-da82c637182a None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.364645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 82/161] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:51.364645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222163d0-5a14-49c6-b32c-da82c637182a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.457044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c377b5a-f331-40a5-9b76-840a6ffab19e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.489369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222163d0-5a14-49c6-b32c-da82c637182a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.502654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.503804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.504230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.504667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.505782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:51.506599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.508584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.520882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 80/162] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.522198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.528517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.529341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.529760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.530131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.531073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:51.531477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.533051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9bc63-fa7a-4789-8d40-506ef09324ff None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.542849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.545081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.545519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.546029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.564617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:51.565994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:51.638084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44e3f2-f634-4caf-868d-af3681b303a1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.643891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 84/164] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:51.647592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.679923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.680847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.681181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.681468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.682724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.684685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.686966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.687865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.772943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea3b1-da30-4da2-a81f-7529be758aad None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.810127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.811018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.811307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.811586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.812934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.814456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.816460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.817294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.825578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96264770-4505-4df3-9afa-3dd949bf78b3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.866922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.868041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.868341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.868796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.870252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.871789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.874340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 82/167] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.875297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:51.921678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0138-caa4-4b0e-a79f-a9f13f2437f6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:51.963781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:51.964466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:51.964747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:51.966163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:51.967046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=2e2d8842c7d74786b278cdcd7a3dd77d) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:51.967356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:51.969504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:51.984439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 86/168] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/role_assignments?user.id=2e2d8842c7d74786b278cdcd7a3dd77d&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:51.985655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.002704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6558ff-d24a-45eb-9345-d692da4752d6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.078551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.079299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.079585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.079869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.103813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bce116-7274-4c6f-bcd2-8f9a0b5b738b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.104918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:52.114765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:52.116888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:52.118788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 83/169] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:52.128301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.151583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.152253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.153131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.153414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.265576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:52.267081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:52.279064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f093d098-115a-4543-a2ea-a590ff1f9c7a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.316639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.317307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.317596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.317872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.391861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:52.393501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:52.479037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 87/170] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:52.479886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.499895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:52.500699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.606914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca80a-518f-4dc2-874a-55e14c4e63b0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.644325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.645176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.645465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.645740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.646949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:52.648506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:52.650295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 85/172] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:52.651168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.692092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a78c7e-7d2f-431d-a20f-16f9ad28ab6d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.754109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.754783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.755068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.755337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.756086 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:52.756411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:52.757771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:52.757979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833535-9bb3-4690-a59b-f88064801096 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:52.775685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 88/173] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:52.776568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.800637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:52.801562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:52.801852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:52.802131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] PATH_INFO: `/v3/projects/0f5d9651373c47ab9705e7180b3dd216` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:52.806188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] RBAC: Authorizing `identity:get_project(project_id=0f5d9651373c47ab9705e7180b3dd216)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:52.807961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:52.812858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 86/174] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/projects/0f5d9651373c47ab9705e7180b3dd216 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:52.814014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:52.937671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6ac73-5243-4767-932b-63d6ced8b177 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.017756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.018500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.018782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.019055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.019888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:53.020195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.024294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.038552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 89/175] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=752329c75e7648f4a9c9d02695370fab => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:53.039181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.046543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e774f-c63f-4b0b-99cf-8ca132371693 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.123677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.124955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.125464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.125955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] PATH_INFO: `/v3/users/a7bb3edff26f4939966d2db53dd69061` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.133209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a7bb3edff26f4939966d2db53dd69061)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.135042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee53b-e4df-443f-acb6-8c14364943e2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.137949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 87/176] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:52 2022] GET /identity/v3/users/a7bb3edff26f4939966d2db53dd69061 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:53.146333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227736b9-1e16-4030-b7b8-46ac9a53660a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.146952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227736b9-1e16-4030-b7b8-46ac9a53660a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.147434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227736b9-1e16-4030-b7b8-46ac9a53660a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.149052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 88/177] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:53.149978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227736b9-1e16-4030-b7b8-46ac9a53660a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.245005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47769a-8f05-4473-a0f3-6048d726ce7d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.323098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.323768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.324054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.324944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.326208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0f5d9651373c47ab9705e7180b3dd216, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:53.326529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.328316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc61a3-0f76-4bb5-ad35-34b4c3868e31 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.334344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 90/178] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=0f5d9651373c47ab9705e7180b3dd216&role.id=752329c75e7648f4a9c9d02695370fab => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:53.335639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.335932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.336212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.358683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:53.360001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:53.370051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227736b9-1e16-4030-b7b8-46ac9a53660a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.426248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.426919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.427203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.427476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.440827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:53.466891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.508660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.510078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.580943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf1ef-263f-4fed-82d4-765494db3257 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.619948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.621024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.621519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.622200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.623581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 89/180] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:53.629096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.634679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:53.643384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:53.644349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:33:53.645129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:53.647544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 92/181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:53.654337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.752997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a018c6f-81d3-466e-bdfa-1009bcc2a81f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.763659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a88c4-ecf9-4388-bb68-7a0f877923d0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.802067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.803105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.803660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.804134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.805171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:53.805678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.807256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.812994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.813866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.814151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.814429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.815678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.817184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.818382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 93/182] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:53.822884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 90/183] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:53.824069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.825104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:53.931010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f13b5-9199-4227-b0cd-559e3d0ed66c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:53.967466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273945-0038-420c-804c-e03c7547a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:53.968765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273945-0038-420c-804c-e03c7547a994 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:53.969281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273945-0038-420c-804c-e03c7547a994 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:53.969781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273945-0038-420c-804c-e03c7547a994 None admin] PATH_INFO: `/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:53.971283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273945-0038-420c-804c-e03c7547a994 None admin] RBAC: Authorizing `identity:get_user(user_id=c89ccb3dd9424d1bb9be1bcffc77a724)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:53.972982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273945-0038-420c-804c-e03c7547a994 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:53.975140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 94/184] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/users/c89ccb3dd9424d1bb9be1bcffc77a724 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:53.981248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273945-0038-420c-804c-e03c7547a994 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:54.056353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b64fe-03a3-41ce-b17a-5e946cb2c9c0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:54.087916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273945-0038-420c-804c-e03c7547a994 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:54.125747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:54.126753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.127247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.127742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.143090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:54.143766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.144046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.144338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.145195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=a7bb3edff26f4939966d2db53dd69061) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:54.145509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:54.146969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:54.159444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 91/185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/role_assignments?user.id=a7bb3edff26f4939966d2db53dd69061&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:54.206365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:54.208324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339335c9-ff23-49f8-b76e-ad0c566de04a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:54.320743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 95/186] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:33:54.327354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:54.489167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa5e87-6155-4ada-bafd-8a36b8738b7f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:54.523317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d032c7-7269-4ce1-b80a-7162a1df1d10 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.523763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d032c7-7269-4ce1-b80a-7162a1df1d10 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.524265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d032c7-7269-4ce1-b80a-7162a1df1d10 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.526011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:54.526870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.527077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 96/187] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:54.527191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.531892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.531892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:54.535470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.535787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:54.536298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.536783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.538117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 92/188] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:54 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:54.546524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:54.565284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:54.567238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:54.648335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 97/189] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:54.662268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd574-dead-4d8b-9cda-d57464fb979c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:54.672909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:54.697984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:54.698564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.698854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.699130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.700010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0, user.id=c89ccb3dd9424d1bb9be1bcffc77a724) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:54.700364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:54.701973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533d921-0f95-40b8-b342-c20db16f0a49 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:54.708112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 93/190] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:54 2022] GET /identity/v3/role_assignments?user.id=c89ccb3dd9424d1bb9be1bcffc77a724&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:54.757462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e0e6-096e-46c5-a6f3-81578019a596 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.758287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e0e6-096e-46c5-a6f3-81578019a596 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.758827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e0e6-096e-46c5-a6f3-81578019a596 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.762385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 94/191] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:54.768560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.768748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.768953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.791355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:54.793966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:54.827990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ce59-6ec5-4179-97b9-f42366c5070b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:54.875331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:54.876492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:54.876973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:54.877381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:54.884426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 95/192] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:54.895214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:54.903616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:54.904717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:54.905525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:54.907760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:54.909514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:54.915183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.019854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c30cb-c4a5-4b74-a7dd-515b1268aa2a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.033428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef02d72-4bee-4a17-afc8-55ec46ffdfde None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.053261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.054050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.054335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.054611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.055776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.057258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa2e8e-f427-443e-a09b-714a2bc12be3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.058884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:55.060190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665607e8-d1f1-4a4a-a791-4abd9bcf65bc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.060508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665607e8-d1f1-4a4a-a791-4abd9bcf65bc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.060791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665607e8-d1f1-4a4a-a791-4abd9bcf65bc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.062162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 97/195] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:55.064388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665607e8-d1f1-4a4a-a791-4abd9bcf65bc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.066004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.066671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.066952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.067227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.067989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:55.068316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.069695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc971e-e520-4222-97eb-c0626b560135 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.078080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 99/196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:55.080142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.080714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.081174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.097387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:55.098580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:55.160784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665607e8-d1f1-4a4a-a791-4abd9bcf65bc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.161244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 100/197] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:55.162111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.194128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.194797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.195080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.195354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.196058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.197530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.222404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 98/198] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:33:55 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:33:55.223215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.266341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae4139-5c69-48a4-b1c9-fd1dca8f0f6b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.303826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.304741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.305024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.305306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.321325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.322824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.325473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 101/199] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:55.330867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.332388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981cfa3-e172-414b-a5a2-3bbfe699fb7d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.370597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.371567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.372429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.372717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.383823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:55.393379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:55.394397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:55.395186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 99/200] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:55.400532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.443336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943a18d-e774-4709-a068-0657835dcd36 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.478733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.479396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.479684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.479977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.518660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b244e0-8539-4911-91ad-667414df5190 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.558091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.559491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.559797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.560080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.560932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:55.561248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.562695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.563964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.565552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.571281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 100/201] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:55.578210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.671845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:33:55.679345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.683349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118fe50-4e01-49ab-b377-150dc69245e3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.718465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.719339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.719624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.719902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.721154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.722697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.724668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 101/203] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:55.729709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.782940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad4ef0-5a65-4d7e-bd58-da41a602f562 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.817811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.819072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.819556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.820027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.821598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.823419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.825648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 103/204] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:55.831571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:55.839738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f780f5-8d75-4a2e-961d-f9fd7795c4f1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.874839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.875517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.875791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.876069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.945144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.946566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:55.951640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb36b-2eb8-4f75-98f7-ff8a115b272c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:55.987151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:55.987971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:55.988260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:55.989380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:55.990229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=08a31e1487584976b8b31f099f8f1fd2) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:55.990547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:55.991998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:56.008653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 104/205] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/role_assignments?user.id=08a31e1487584976b8b31f099f8f1fd2&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:56.062543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 102/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:56.068030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:56.185951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588c185-447e-45aa-83ce-4e739f5ef895 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:56.220782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:56.221572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:56.221856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:56.222131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:56.223435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:56.224921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1cd27-18d5-4991-a988-7e359f4effdb None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:56.226943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:56 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:56.233715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:56.336062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a4034-54a1-4af7-8f76-6e87efafa97f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:56.369777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:56.370431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:56.370716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:56.370993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:56.372461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=08a31e1487584976b8b31f099f8f1fd2) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:56.372777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:56.374238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2bb251-1a5b-40f1-a693-1752ffbc4e94 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:56.379744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 103/208] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:56 2022] GET /identity/v3/role_assignments?user.id=08a31e1487584976b8b31f099f8f1fd2&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:57.689338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae9a-63f6-4296-b9a4-9e91536576cf None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:57.689844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae9a-63f6-4296-b9a4-9e91536576cf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:57.689951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372ae9a-63f6-4296-b9a4-9e91536576cf None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:57.691263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 106/209] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:57.696721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:57.697125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:57.697295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:57.714454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:57.716621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:57.739244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019e59-75c6-4cee-87ab-bf4c0631467d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:57.739530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019e59-75c6-4cee-87ab-bf4c0631467d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:57.739802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019e59-75c6-4cee-87ab-bf4c0631467d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:57.741459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 107/210] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:57.746888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:57.747172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:57.747540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:57.766426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:57.768149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:57.794591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 104/211] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:57.819182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:57.847767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:33:57.873107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:57.938166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885281a6-ef1a-47d6-8364-bb5563e11629 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:57.978196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:57.978998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:57.979375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:57.979744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:57.991731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:57.993777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105617-7b5a-48b3-a79b-eb33c1119968 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:57.999645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:58.001739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:33:58.003632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:58.012295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:58.012295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.036186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.037623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.038045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.038333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.039902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.041686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.044765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:33:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:58.051147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.109146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469a7b9-b2e0-4e15-b796-54142ae0a3c2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.148264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.149057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.149347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.149621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.150382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:58.150697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.152490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.164352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:58.167067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.184928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62f2dd-83b6-4e00-b477-8b71a11c6d7a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.222076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.222787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.223134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.223335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.224049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.225549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.252615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 110/216] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:33:58 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:33:58.290153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f95f-3a62-44aa-a3e0-1eadb4e824c9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.331783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.332708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.332990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.333263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] PATH_INFO: `/v3/users/606bf5e4ef5943bd934b7c7c0b29325b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.348498 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] RBAC: Authorizing `identity:get_user(user_id=606bf5e4ef5943bd934b7c7c0b29325b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.350003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f1e82-f191-4b87-afbe-9af7413bfcc6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.352217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 107/217] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/users/606bf5e4ef5943bd934b7c7c0b29325b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:58.358593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.394324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ed83-df20-443f-a619-ca6bfdb50ba4 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.394607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ed83-df20-443f-a619-ca6bfdb50ba4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.394800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0ed83-df20-443f-a619-ca6bfdb50ba4 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.396399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 108/218] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:33:58.401673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.401968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.402225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.422281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:58.424250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:58.469665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b065e18-6aa8-4523-919f-4ec1a8515937 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.513558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:58.518707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.518875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.519082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.522065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.537861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.618818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.619434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.685506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08ce3-6833-473a-b8e4-702f82e10416 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.724223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.724881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.724881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.725112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.735437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-59a65c98-3125-4ec2-95b2-1e9bbce1155a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:58.743701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:58.744653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:33:58.745937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 110/220] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:33:58.747352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e657-0b1b-4213-8a01-06db6058682c None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.747352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e657-0b1b-4213-8a01-06db6058682c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.747352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e657-0b1b-4213-8a01-06db6058682c None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.752393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 111/221] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:33:58.754339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.754339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.754507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.768714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 111/222] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:33:58.769339 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.773621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:33:58.774797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:33:58.857984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:33:58.858889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.906446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074f772-20bd-49cf-b1e7-42e838692a1f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:58.955623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:58.956227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:58.956551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:58.956832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:58.957986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:58.958296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:58.960355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:58.971832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:58.972687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:58.984663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146a06-1a17-4a0f-b2f4-8d75050ea220 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.021617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.022501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.022785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.023060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.024644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.026798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.029432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.030303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.089502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30095bd6-4b16-4bdb-9a2b-9b211cdf77c3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.125662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.126862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.127383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.127854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.139321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:33:59.147882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:33:59.148774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:33:59.149550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:33:59.150148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9afe3-b1c2-4455-a954-a8abd074cab8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.152056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:33:59.153104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.189984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.190866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.191148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.191423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.192680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.194258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.195959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 114/227] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.196748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.256542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55646-0486-4895-ac2d-5a7f5487cefb None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.291699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.292728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.293308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.293794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.294858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=606bf5e4ef5943bd934b7c7c0b29325b) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:59.295369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.297040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.297636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15812df-2135-43cb-8591-dc1a0a715942 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.303432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 114/228] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/role_assignments?user.id=606bf5e4ef5943bd934b7c7c0b29325b&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=752329c75e7648f4a9c9d02695370fab => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.304593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.338680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.340936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.341448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.341946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.342905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:33:59.343476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.346254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.356913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 115/229] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.362736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.418577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284eb0-3e25-4a1f-bfee-3f3e3f6d2a8d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.455091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.456371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.456870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.457351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.458955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.460675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.462912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 115/230] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.473344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.480024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98e162-2f5d-453b-85ad-8db15dc89292 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.524682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.524682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.524682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.524682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.525106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.525106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.525106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 116/231] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:33:59.539175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.676907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4590282-b511-4946-9c25-3646eafa169b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.710287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377938db-bf8f-40d1-80a8-2aae4dbae9a8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.714038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.715452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.715736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.716009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/08a31e1487584976b8b31f099f8f1fd2/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.718055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, user_id=08a31e1487584976b8b31f099f8f1fd2, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.719959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.737031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 116/232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:59 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/08a31e1487584976b8b31f099f8f1fd2/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:33:59.773722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.775584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.776115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.776600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.785435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.787492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3dc87-fc71-4159-abdd-ac549fb98fbb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.789847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 117/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:33:59 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:33:59.796719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:33:59.913643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3bdc5-ce4f-4952-a442-e80beddb98a2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:33:59.951107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:33:59.952023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:33:59.952332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:33:59.952611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/08a31e1487584976b8b31f099f8f1fd2/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:33:59.954930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, user_id=08a31e1487584976b8b31f099f8f1fd2, role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:33:59.956450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e4cca-c7cb-46c1-9c01-b61186977392 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:33:59.974746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:33:59 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/08a31e1487584976b8b31f099f8f1fd2/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:01.075159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4f85-b148-4cd7-9583-ff6a4b7abf56 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.076216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4f85-b148-4cd7-9583-ff6a4b7abf56 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.076732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e4f85-b148-4cd7-9583-ff6a4b7abf56 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.078418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:01.084211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e706e7-3f13-417e-af88-607f1104a97b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.085177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e706e7-3f13-417e-af88-607f1104a97b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.085940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e706e7-3f13-417e-af88-607f1104a97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.109260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c8e706e7-3f13-417e-af88-607f1104a97b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:01.110797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c8e706e7-3f13-417e-af88-607f1104a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:01.193498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 118/236] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:01.247075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4f85-b148-4cd7-9583-ff6a4b7abf56 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:01.278243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9bf2f-d4f0-413f-86ca-4b61dc1a3ee8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.278609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9bf2f-d4f0-413f-86ca-4b61dc1a3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.278799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9bf2f-d4f0-413f-86ca-4b61dc1a3ee8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.280211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 119/237] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:01.290185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.290479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.290763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.309929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:01.311249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:01.416436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:01.436974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e4f85-b148-4cd7-9583-ff6a4b7abf56 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:01.460167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:01.498540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:01.499345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.499602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.499880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.501072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:01.502527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:01.508581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:01.513468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:01.572681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c600e-793f-4efd-878f-6054d3aeef33 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:01.616779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:01.617581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.617863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.618134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.644182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:01.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:01.661579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:01.662354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 121/240] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:01.669430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:01.708619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd442f-8e2c-489c-9fcc-79335c227a57 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:01.747274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:01.748886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.749171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.749449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.750164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:01.751624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:01.800551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 120/241] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:01 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:34:01.842174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fa944-0160-48d4-a67e-f0df07ce9801 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:01.884036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:01.884816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:01.885107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:01.885385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:01.886172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:01.886484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:01.888045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:01.897641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 122/242] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:01.903734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.037963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f30451-2388-422e-a79b-734fe8d90945 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.080000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.080910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.081188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.081457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] PATH_INFO: `/v3/users/034de50409054e97ad195022acd2b965` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.095955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] RBAC: Authorizing `identity:get_user(user_id=034de50409054e97ad195022acd2b965)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.097508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99a399-a2cb-4b5e-b1f2-f724512955e8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.099572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 121/243] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:01 2022] GET /identity/v3/users/034de50409054e97ad195022acd2b965 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:02.104850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.193964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c087-33bb-4ffa-bc48-24efd6f6fcdd None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.194323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c087-33bb-4ffa-bc48-24efd6f6fcdd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.194521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c087-33bb-4ffa-bc48-24efd6f6fcdd None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.196180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 122/244] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:02.203987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.203987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.203987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.221987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:02.222775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a4613-b5c2-4619-8f1a-f484568b1845 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.223724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:02.260578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.261239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.261523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.261836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.295530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:02.320223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.333951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.335416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.427609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0555b7-a311-45ac-9a78-e222bf5ade3b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.435099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 123/246] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:02.440248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.463611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.464703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.465647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.466069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.476949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:02.485459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:02.486372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:02.487171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:02.489940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 124/247] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:02.495786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.548707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646c2ed-4ccf-4fb7-9f43-795f0c4a0f5a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.584728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.585619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.585898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.586169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.587415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.588881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.591573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 124/248] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:02.596932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.639378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f079ae-f40a-41de-ad90-c7a56530edb8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.710704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d13d1-436a-458b-9bf9-64286685cfc4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.715914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.716665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.716951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.717223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.717980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:02.718284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.719685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.728370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:02.737323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.755371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.756097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.756416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.756698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.757659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=034de50409054e97ad195022acd2b965) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:02.758028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.759569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83f5b-99b2-4c96-9700-26b84acb39d4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.772791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/role_assignments?user.id=034de50409054e97ad195022acd2b965&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:02.775170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506918a-0a6c-4cd5-8c7e-274f033ab84f None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.775701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506918a-0a6c-4cd5-8c7e-274f033ab84f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.776422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506918a-0a6c-4cd5-8c7e-274f033ab84f None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.779867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 126/251] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:02.781711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939da44-ccce-4644-b9e2-0e7b0254decf None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.782219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939da44-ccce-4644-b9e2-0e7b0254decf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.782695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939da44-ccce-4644-b9e2-0e7b0254decf None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.784674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 127/252] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:02.790145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3e2-46d6-4bd6-af77-3bbb0ddac065 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.790335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3e2-46d6-4bd6-af77-3bbb0ddac065 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.790543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3e2-46d6-4bd6-af77-3bbb0ddac065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.817032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9a9ef3e2-46d6-4bd6-af77-3bbb0ddac065 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:02.819390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9a9ef3e2-46d6-4bd6-af77-3bbb0ddac065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:02.863568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e2096-47cd-4e80-b1c1-e2231909951c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:02.899444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:02.900667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.901116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.901601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] PATH_INFO: `/v3/users/606bf5e4ef5943bd934b7c7c0b29325b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.903509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] RBAC: Authorizing `identity:get_user(user_id=606bf5e4ef5943bd934b7c7c0b29325b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:02.905494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:02.907649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 126/254] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/users/606bf5e4ef5943bd934b7c7c0b29325b => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:02.907755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 128/254] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:02.912607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:02.912903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:02.913180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:02.913843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:02.950997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:02.953509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:03.094331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:03.095704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.110611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423bc5-677d-4744-b97c-d673d559abd8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.175400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.176653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.178229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.178730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.181963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:03.184330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:03.189362 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 127/256] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:02 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:03.191442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.304075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e9616-ac14-4859-a5ac-53e2697e64db None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.316796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138b57-8993-45f7-823f-89925d1b0bff None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.352329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.353512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.353998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.354485 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.370642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:03.380996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:03.381896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:03.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:03.385562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 128/257] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:03.386583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.401003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.401820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.402106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.402431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.433925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:03.450687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:03.451639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:03.452477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:03.453126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.533310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28814b-5c4a-4947-9153-f95975af013b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.591119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c91aa-bf5d-4d7a-9915-387ab38f8ed6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.624944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.625840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.626128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.626408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/606bf5e4ef5943bd934b7c7c0b29325b/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.627010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.627882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.628405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.628882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.629827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:03.630361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:03.631927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:03.633562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, user_id=606bf5e4ef5943bd934b7c7c0b29325b, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:03.635027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:03.641261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:03.642293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.679335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:03 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/606bf5e4ef5943bd934b7c7c0b29325b/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:03.679634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.786901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222fda5-f685-4a08-b9a1-4912d03e1c25 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:03.868937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:03.869633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:03.869918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:03.870198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:03.871071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:03.871998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:03.873460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:03.892392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:03.898165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:03.946118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571489b4-82d2-4ca1-b0ef-2342cce4667d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.018201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.018966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.019248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.019521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.021251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.022722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.027066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:04.031037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:04.087851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec0e93-7ede-43d8-9959-7b2198071ae2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.156057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.156880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.157161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.157440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] PATH_INFO: `/v3/users/08a31e1487584976b8b31f099f8f1fd2` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.160984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] RBAC: Authorizing `identity:get_user(user_id=08a31e1487584976b8b31f099f8f1fd2)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.162448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.164451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 133/263] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:03 2022] GET /identity/v3/users/08a31e1487584976b8b31f099f8f1fd2 => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:04.164559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcdb32-2294-4d87-ad35-9c1c7d10bdda None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.169807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:04.198515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.199709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.200001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.200448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.267087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.268596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.366635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:04.376265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:04.387324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c99a-7b69-45da-b3ee-dccbbc72751c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.482990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8992-6d58-4caf-8e1f-1e0266bceea6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.484979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.485642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.485922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.486198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.520043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.521084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.521374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.521652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.522863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.524650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.526809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 132/265] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:04 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:04.535159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:04.640000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148984-d0a6-4df5-a2f3-4635cb1f3f91 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.669366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.670871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.680017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.680712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.680991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.686453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.687306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=08a31e1487584976b8b31f099f8f1fd2) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:04.687618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:04.689097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:04.705296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 133/266] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:04 2022] GET /identity/v3/role_assignments?user.id=08a31e1487584976b8b31f099f8f1fd2&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:04.823240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 134/267] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:04.825343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:04.950181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bee6a-2fd0-4578-8d8f-0efd75070fcb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:04.995812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:04.996884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:04.997164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:04.997433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:04.998627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:05.000104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78e0e7-d314-4079-a665-804cbb50fd3d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:05.003105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:04 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:05.007984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:05.152017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fba2b-52a0-4c8f-a5bf-c46a0f95734b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:05.201887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:05.202549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.202831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.203100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.203943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=08a31e1487584976b8b31f099f8f1fd2) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:05.204255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:05.205729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f5a80-b306-4f3f-b9f2-9dd002de98a7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:05.217519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 135/269] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:05 2022] GET /identity/v3/role_assignments?user.id=08a31e1487584976b8b31f099f8f1fd2&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:05.473563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376b7-4ced-45aa-98a4-6b129d42beb1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.474056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376b7-4ced-45aa-98a4-6b129d42beb1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.474056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7376b7-4ced-45aa-98a4-6b129d42beb1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.475443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 135/270] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:05.481934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5990-4c45-4c72-ad64-44103188394e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.482440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5990-4c45-4c72-ad64-44103188394e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.482514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5990-4c45-4c72-ad64-44103188394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.502995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c86a5990-4c45-4c72-ad64-44103188394e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:05.504350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c86a5990-4c45-4c72-ad64-44103188394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:05.587948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 136/271] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:05.612604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7376b7-4ced-45aa-98a4-6b129d42beb1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:05.717002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7376b7-4ced-45aa-98a4-6b129d42beb1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:05.757768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:05.758544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.760398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583c04-aba3-44f5-a438-8770bd368ebf None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.760510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.760675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583c04-aba3-44f5-a438-8770bd368ebf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.760793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.760944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583c04-aba3-44f5-a438-8770bd368ebf None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.762683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 137/272] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:05.769002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.769372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.769554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.777935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:05.785688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:05.786566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:05.787361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:05.792307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:05.792307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:05.792618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 136/273] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:05.794139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:05.879291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 138/274] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:05.906850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:05.907932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f8fb-c0c1-421e-8853-c5b2e816bc21 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:05.947322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:05.948015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.948359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.948643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.949982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:05.950295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:05.951684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c752b-956f-42bf-ba5e-8abe910a82ee None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:05.959704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 137/275] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:05.960973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3655-7203-4567-8e9c-ca10e8d63c3e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:05.961261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3655-7203-4567-8e9c-ca10e8d63c3e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:05.961568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3655-7203-4567-8e9c-ca10e8d63c3e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:05.964450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 138/276] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:05.965843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba3655-7203-4567-8e9c-ca10e8d63c3e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.020917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084882d-7570-46af-80f8-87b2ee7de961 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.054477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.055268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.055555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.055825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.056999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.059173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ecc50-80a5-4036-971c-3f6d6c6292c2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.061075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 139/277] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:06.061958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.062239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.062508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.070331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba3655-7203-4567-8e9c-ca10e8d63c3e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.079553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:06.080785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:06.104221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.105123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.105944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.106223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] PATH_INFO: `/v3/users/1a795a8d7d8b465aa8551efa05a1afb7` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.119696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1a795a8d7d8b465aa8551efa05a1afb7)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.121923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.123630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 139/278] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:05 2022] GET /identity/v3/users/1a795a8d7d8b465aa8551efa05a1afb7 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:06.128923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.156307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 140/279] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:06.156307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.243930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a3d77-7bb7-48fb-b051-ff55094b900b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.244131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5807d-22ff-45b1-8934-af63295841d7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.276671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.278194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.278194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.278498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.279273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, user.id=1a795a8d7d8b465aa8551efa05a1afb7, scope.system=all) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:06.279583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.280103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.280861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.281109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.281201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.281408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.282110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.283551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.295145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 141/280] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/role_assignments?user.id=1a795a8d7d8b465aa8551efa05a1afb7&scope.system=all&role.id=752329c75e7648f4a9c9d02695370fab => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:06.295145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.310546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 140/281] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:06 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:06.433176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201f49f-61ba-44eb-9e17-90e581808ac6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.474651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.475467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.475758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.476032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.489046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-bee02a7a-1e3a-4f9a-b076-c9ee3c55be8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:06.497680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:06.499920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:06.501820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 142/282] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:06.509435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.575572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188bac-605b-4cf9-8a70-bfbdb6c7692c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.575869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188bac-605b-4cf9-8a70-bfbdb6c7692c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.576057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68188bac-605b-4cf9-8a70-bfbdb6c7692c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.577754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 143/283] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:06.583346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.583715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.584067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.604083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:06.606452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:06.614354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa38e8-83ad-4101-ae90-4038216385a6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.649183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.649861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.650149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.650429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.651196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:06.651507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.653845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.662459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:06.668684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.690055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 144/285] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:06.717270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.785715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9f5e-22ce-459a-a4f5-49256c72765d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.832377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569c537-582b-4d6f-9dc4-1b578ffbffb5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:06.832634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.832634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.832634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.832634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] PATH_INFO: `/v3/users/034de50409054e97ad195022acd2b965` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.835104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] RBAC: Authorizing `identity:get_user(user_id=034de50409054e97ad195022acd2b965)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:06.840995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:06.842902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 142/286] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/users/034de50409054e97ad195022acd2b965 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:06.849539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:06.899564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:06.900389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:06.900674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:06.900947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:06.925579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:06.933480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:06.934361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:06.935160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:06.937216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:06.945632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:07.018146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba51-d0f2-49df-b69b-cc94f6e96d5f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.052145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.054358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.054642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.054920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.062735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.064365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.068037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 143/288] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:07.073664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:07.125050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8ad43-0a94-4329-9ef6-e438637843c1 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.175754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ce413-0405-4236-ab61-890aca7c3737 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.177957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.178638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.178919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.179193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.183197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:07.184048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.187695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.206113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:07.211729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:07.224671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.225550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.225837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.226113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/034de50409054e97ad195022acd2b965/roles/1464e5118cb541829ef3997b1b11b6c9` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.228089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, user_id=034de50409054e97ad195022acd2b965, role_id=1464e5118cb541829ef3997b1b11b6c9)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.229592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.250846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 144/290] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:07 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/users/034de50409054e97ad195022acd2b965/roles/1464e5118cb541829ef3997b1b11b6c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:34:07.352912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af3852-97c1-4c73-8986-eb3e8dae84b7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.408854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.409729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.410019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.410295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] PATH_INFO: `/v3/users/606bf5e4ef5943bd934b7c7c0b29325b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.411546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] RBAC: Authorizing `identity:get_user(user_id=606bf5e4ef5943bd934b7c7c0b29325b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.413068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.415070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 147/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:07 2022] GET /identity/v3/users/606bf5e4ef5943bd934b7c7c0b29325b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:07.422453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:07.561834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a599c-d9ba-4b22-b93e-e796056f984c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.598266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.598978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.599269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.599543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.670342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.671803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.775386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:07.781301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:07.907159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77f563-2fd4-45de-8ae8-505ddef9e123 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:07.956642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:07.957430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:07.957716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:07.957992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:07.959187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:07.960729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139919d3-36a7-4a40-af1e-0a75e36a74dd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:07.962777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:07 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:07.969056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:08.072663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3857d7-86df-4543-9de6-23b150db482a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:08.107211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:08.107872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:08.108157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:08.108464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:08.109354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=606bf5e4ef5943bd934b7c7c0b29325b) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:08.109669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:08.111118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fa4c7-6c03-401c-a230-f6d08fb4164e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:08.117424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:07 2022] GET /identity/v3/role_assignments?user.id=606bf5e4ef5943bd934b7c7c0b29325b&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=752329c75e7648f4a9c9d02695370fab => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:08.833327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01e9b4-4dae-47d0-bcfc-8dfe33b54cc9 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:08.833808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01e9b4-4dae-47d0-bcfc-8dfe33b54cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:08.833808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01e9b4-4dae-47d0-bcfc-8dfe33b54cc9 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:08.835407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:08.841769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:08.842611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:08.843085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:08.860500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:08.861968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:08.931278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:08.954719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01e9b4-4dae-47d0-bcfc-8dfe33b54cc9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.058126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01e9b4-4dae-47d0-bcfc-8dfe33b54cc9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.093026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.093774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.094062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.094340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.107189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-723e7855-8cdd-4099-86f2-45e99425d9d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:09.115164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:09.116100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:09.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 150/297] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:09.124760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.127745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4537e8-7254-4944-aab0-fab5657a4ad0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.128043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4537e8-7254-4944-aab0-fab5657a4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.128348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4537e8-7254-4944-aab0-fab5657a4ad0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.129847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 151/298] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:09.134779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.135069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.135352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.153377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:09.154587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:09.227360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 152/299] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:09.231175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921600b4-d8aa-40ab-a580-0f992e6e84b7 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.244904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.265794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.266789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.267272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.267763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.268824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:09.269331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.270920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.280324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 148/300] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:09.285487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.344541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882a1f7-4fab-45ac-9fb2-1bbf177c4615 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.377741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.378534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.378819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.379098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.380253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.381727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f77e1-07c7-4225-8216-1b8499fe79db None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.388342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 153/301] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:09.388481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8865376-7e81-4eeb-aaca-8f3c0d250993 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.388572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284524-e20b-4581-9dd7-4269ff4b555b None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.388572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284524-e20b-4581-9dd7-4269ff4b555b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.388572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79284524-e20b-4581-9dd7-4269ff4b555b None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.388572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 154/302] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:09.392413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284524-e20b-4581-9dd7-4269ff4b555b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.421951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.422906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.423255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.423615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] PATH_INFO: `/v3/users/1a795a8d7d8b465aa8551efa05a1afb7` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.425161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] RBAC: Authorizing `identity:get_user(user_id=1a795a8d7d8b465aa8551efa05a1afb7)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.426703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d67a8a-4723-428b-a01c-a656909be049 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.433004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 149/303] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/users/1a795a8d7d8b465aa8551efa05a1afb7 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:09.433004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.433004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.433004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.446403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:09.447565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:09.500951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79284524-e20b-4581-9dd7-4269ff4b555b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.520304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 150/304] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:09.520304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.556221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.556928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.557210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.557490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] PATH_INFO: `/v3/groups` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.558177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.560161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.575377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 155/305] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 10 16:34:09 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:09.577204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.634879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d501e-5ce4-4898-9530-adfc4a5c781a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.675605 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.676926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.677430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.677912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] PATH_INFO: `/v3/system/users/1a795a8d7d8b465aa8551efa05a1afb7/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.679812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1a795a8d7d8b465aa8551efa05a1afb7, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.681574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.689774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e24fc-9672-4da2-b3bb-0a24f8762a9f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.695104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 151/306] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 10 16:34:09 2022] PUT /identity/v3/system/users/1a795a8d7d8b465aa8551efa05a1afb7/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:09.732477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.733556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.733988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.734444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.747829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:09.756725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:09.757853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:09.758883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:09.762153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 156/307] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:09.769523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:09.892417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f154a0f-48a6-4363-941a-77681d74bf43 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:09.929364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:09.930040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:09.930325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:09.930602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:09.931359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:09.931668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:09.933075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717068ba-b871-4741-bac1-758b03c60b00 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:09.942225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 152/308] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:09.947548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.047456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a237-c6e3-4b7a-a71b-29f70a452d33 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.047770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a237-c6e3-4b7a-a71b-29f70a452d33 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.048017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069a237-c6e3-4b7a-a71b-29f70a452d33 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.049908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 153/309] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:10.053860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a545f-b482-47c4-854e-2d2c77b15f2e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.054656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.054934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.055206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.071975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:10.073162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:10.090921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.091916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.092204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.092515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] PATH_INFO: `/v3/users/18fb200c8bcb44d6982970a6d05b26b2` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.107100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=18fb200c8bcb44d6982970a6d05b26b2)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:10.108607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:10.110628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 157/310] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:09 2022] GET /identity/v3/users/18fb200c8bcb44d6982970a6d05b26b2 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:10.116205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.148422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 154/311] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:10.165057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.219843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d35ae4-7d41-4a83-bf07-80a384cc3ef0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.255139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.255795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.256080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.256388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.257229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, user.id=18fb200c8bcb44d6982970a6d05b26b2, scope.system=all) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:10.257544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:10.258990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:10.263438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788032f-0b9e-4dcd-b806-786803e551b8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.265282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 158/312] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/role_assignments?user.id=18fb200c8bcb44d6982970a6d05b26b2&scope.system=all&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:10.300941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.301756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.302040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.302313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.314789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:10.322602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:10.325617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:10.327648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 155/313] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:10.334114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.443319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb66d9-0235-4b17-8301-3314df8aabbe None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.489211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.489894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.490175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.490456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.491212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:10.491521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:10.492932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:10.502517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 159/314] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:10.507777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.609736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513e79c-b8ae-45b0-ac01-3a05ca521912 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.650724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.651827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.652894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.653333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] PATH_INFO: `/v3/users/034de50409054e97ad195022acd2b965` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.654652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] RBAC: Authorizing `identity:get_user(user_id=034de50409054e97ad195022acd2b965)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:10.656236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:10.658365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 156/315] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/users/034de50409054e97ad195022acd2b965 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:10.663542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:10.765680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a8d3f-729c-4b84-b64d-f775435d3850 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:10.801471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:10.802354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:10.802773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:10.803183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:10.874141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:10.875634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:10.979942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 160/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:10.985947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:11.082311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e466575-8b92-4788-bcd4-4ee304dc1434 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:11.115284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:11.116167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:11.116526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:11.116809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:11.117984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:11.119438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c5f75-116f-4592-ab3c-7c9fba2eef7f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:11.121980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 157/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:10 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:11.127914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:11.233358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83191-32f8-470b-961b-5f1680bb18b3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:11.268872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:11.269528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:11.269813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:11.270088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:11.270915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, scope.project.id=0ca399420581481588ea4f1a8441b0e1, user.id=034de50409054e97ad195022acd2b965) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:11.271229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:11.272701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fbb4-8961-4d83-a8c7-c60ca38dbf77 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:11.279678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 161/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:11 2022] GET /identity/v3/role_assignments?user.id=034de50409054e97ad195022acd2b965&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:11.907176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3049a-6f24-47c0-ae6d-5718608031cd None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:11.907593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3049a-6f24-47c0-ae6d-5718608031cd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:11.907768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3049a-6f24-47c0-ae6d-5718608031cd None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:11.909306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 158/319] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:11.914872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af3-c8f2-43d1-9266-522714078f82 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:11.915165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af3-c8f2-43d1-9266-522714078f82 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:11.915443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6af3-c8f2-43d1-9266-522714078f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:11.932563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b09c6af3-c8f2-43d1-9266-522714078f82 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:11.933875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b09c6af3-c8f2-43d1-9266-522714078f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:11.997647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 162/320] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:12.020553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3049a-6f24-47c0-ae6d-5718608031cd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.070525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5abfe-edf2-4b4f-8747-36ad706516dc None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.070858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5abfe-edf2-4b4f-8747-36ad706516dc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.071094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5abfe-edf2-4b4f-8747-36ad706516dc None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.072627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 163/321] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:12.078108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.078475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.078828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.096243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:12.097650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:12.121555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3049a-6f24-47c0-ae6d-5718608031cd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.154945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.155736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.156020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.156318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.157537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:12.158919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:12.160715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 159/322] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:12.164677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 164/323] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:12.166337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.187557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.269943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ef1e-66c6-4714-a56f-ea0f36e6ccc3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.284624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f72a0-1609-4a5a-9bff-d763876b370e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.305523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.306186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.306469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.306743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] PATH_INFO: `/v3/groups` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.307432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:12.309474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:12.320202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.321072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.321380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.321664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.325833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 160/324] 10.222.0.48 () {60 vars in 1134 bytes} [Tue May 10 16:34:12 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:34:12.333838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:12.341843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:12.342794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:12.343607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:12.348134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 165/325] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:12.349549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.458472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5517d6-cf89-4410-a381-4d10f9d25271 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.494556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.495237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.495520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.496348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.497168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:12.497445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:12.499210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45330856-7ec7-4d3f-afee-d26abcb1c2d6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:12.508245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 161/326] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:12.514999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.618575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc725-0ae6-4a94-9c90-e59866a49038 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.643484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2eb91-f00c-45aa-8b46-611aa3218902 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.643807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2eb91-f00c-45aa-8b46-611aa3218902 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.644054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2eb91-f00c-45aa-8b46-611aa3218902 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.645447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 162/327] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:12.650785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7f37-2436-483d-bb43-29234691179b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.651068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7f37-2436-483d-bb43-29234691179b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.651349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7f37-2436-483d-bb43-29234691179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.655751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.656680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.656966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.657243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] PATH_INFO: `/v3/users/1a795a8d7d8b465aa8551efa05a1afb7` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.658588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] RBAC: Authorizing `identity:get_user(user_id=1a795a8d7d8b465aa8551efa05a1afb7)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:12.660076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:12.662197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 166/328] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/users/1a795a8d7d8b465aa8551efa05a1afb7 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:12.667463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.676818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-190d7f37-2436-483d-bb43-29234691179b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:12.678159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-190d7f37-2436-483d-bb43-29234691179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:12.771873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 163/329] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:12.791586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef97d8-bc9a-4c35-b3c7-e703d5d85c97 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.795298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7f37-2436-483d-bb43-29234691179b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:12.834021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.835063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.835552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.836030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.837153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] RBAC: Adding query filter params (role.id=752329c75e7648f4a9c9d02695370fab, user.id=1a795a8d7d8b465aa8551efa05a1afb7, scope.system=all) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:12.837674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:12.839481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:12.853161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 167/330] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/role_assignments?user.id=1a795a8d7d8b465aa8551efa05a1afb7&scope.system=all&role.id=752329c75e7648f4a9c9d02695370fab => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:12.915041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7f37-2436-483d-bb43-29234691179b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:12.959816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:12.961058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:12.961554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:12.962047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:12.978479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:12.990139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:12.992486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:12.993267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 164/331] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:12.996904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:13.115436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1c79-2245-4a47-aa71-787f65e27c91 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:13.150778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:13.151455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:13.151741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:13.152564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:13.153334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:13.154024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:13.155454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:13.164870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 168/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:13.170783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:13.276141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d5981-30bb-473d-8ff8-4a0ed4e06edb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:13.311176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:13.312421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:13.312899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:13.313356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] PATH_INFO: `/v3/users/18fb200c8bcb44d6982970a6d05b26b2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:13.314780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] RBAC: Authorizing `identity:get_user(user_id=18fb200c8bcb44d6982970a6d05b26b2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:13.316459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137258c6-01cd-4074-8625-264d2eb7ee77 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:13.318548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:13 2022] GET /identity/v3/users/18fb200c8bcb44d6982970a6d05b26b2 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:13.324267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:13.428496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af379169-29ce-4cb0-9a0b-70bc410058b4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:13.465054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:13.466243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:13.466721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:13.467182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] PATH_INFO: `/v3/system/users/18fb200c8bcb44d6982970a6d05b26b2/roles/1464e5118cb541829ef3997b1b11b6c9` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:13.468911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=18fb200c8bcb44d6982970a6d05b26b2, role_id=1464e5118cb541829ef3997b1b11b6c9)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:13.470485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b19a7e-8b12-461c-9de2-ea8714452b47 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:13.484625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 169/334] 10.222.0.48 () {58 vars in 1334 bytes} [Tue May 10 16:34:13 2022] PUT /identity/v3/system/users/18fb200c8bcb44d6982970a6d05b26b2/roles/1464e5118cb541829ef3997b1b11b6c9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:14.949636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e8d5-0ab6-4e52-b91a-8b230cd28f44 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:14.950673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e8d5-0ab6-4e52-b91a-8b230cd28f44 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:14.951166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0e8d5-0ab6-4e52-b91a-8b230cd28f44 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:14.953072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:14.970424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:14.971366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:14.971854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:14.993340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:14.994876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:15.076786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:15.110291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e8d5-0ab6-4e52-b91a-8b230cd28f44 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:15.228184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0e8d5-0ab6-4e52-b91a-8b230cd28f44 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:15.262283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:15.263143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:15.263425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:15.263700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:15.276902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:15.284875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:15.285780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:15.286593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 167/337] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:15.294311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:15.407459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5872d7-0358-439c-af39-f4bd8b35aafc None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:15.452844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:15.453945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:15.454438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:15.454923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:15.455912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:15.456464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:15.458135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e032405-291f-4715-9ffa-2aa0642e93ae None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:15.468917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 171/338] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:15.476079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:15.529825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e9c-de79-4bae-9f57-4d328ba829a8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:15.530433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e9c-de79-4bae-9f57-4d328ba829a8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:15.530909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b07e9c-de79-4bae-9f57-4d328ba829a8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:15.532517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 172/339] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:15.538408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:15.539224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:15.539714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:15.569426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:15.570624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:15.600910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046a86-890c-4d17-9d61-5d3fd32bd7fb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:15.645819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:15.646490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:15.646777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:15.647061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:15.746020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 173/340] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:15.746573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:15.747801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:15.825628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:15.863134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 168/341] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:15.869926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:15.962771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb079d-f2d7-48fb-ac43-f3b4934acee5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.002904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.004567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.005049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.005532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.012688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522d75-3a73-41a6-a21a-b17dadacad8b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.021308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-ca461265-4ce6-471b-98dd-c83d181ff28a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:16.030046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:16.030905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:16.031686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 174/342] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:16.033134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb35dd4-9f20-490f-bff9-9e115dc994b8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.033134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb35dd4-9f20-490f-bff9-9e115dc994b8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.033134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb35dd4-9f20-490f-bff9-9e115dc994b8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.034263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 175/343] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:16.039748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb35dd4-9f20-490f-bff9-9e115dc994b8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.052040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.052933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.053215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.053491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.055335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.057178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56516d-4a61-41b1-8405-5100c4cd9402 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.060019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 169/344] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:15 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:16.061473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.061756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.062416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.082137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:16.084140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:16.169595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb35dd4-9f20-490f-bff9-9e115dc994b8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.184544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 170/345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:16.185384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.205778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.206440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.206723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.206993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.207781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:16.208130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.209595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.218867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 176/346] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:16.229376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.309090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fac299-272d-49d3-b757-7f0b26f938b1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.346599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.347369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.347651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.347925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.357253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.358781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.360711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 171/347] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:16.361294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.378439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201c42-5013-421f-9422-440d5052d499 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.462078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304293b5-e2a1-4336-ad4a-1e98302a1f9b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.477020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.477692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.477981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.478270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.498255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.499058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.499393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.499665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.510339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:16.518302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:16.520434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 172/348] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:16.522374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.621088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f94f9d-bf98-4657-8e90-2bd39991e551 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.646201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.647679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.675994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.676775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.677055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.677328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.678173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:16.678483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.679934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.697333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 173/349] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=752329c75e7648f4a9c9d02695370fab => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:16.698186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.830810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a12fb-afdd-4b06-b810-66139dd0ee30 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:16.861250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 177/350] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:16.866484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.868109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:16.868822 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:16.869151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:16.869432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:16.870188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:16.871041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:16.872544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:16.883007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 174/351] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:16.888644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:16.991874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949890-dfd2-482e-80e5-566d251ef266 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.028250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.029053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.029224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.029483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.082792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d17bcd-dcb9-42fe-8b2e-b0e966a0f4fd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.106644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.108218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.138292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.139095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.139373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.139651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.140885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.142342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.144361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 178/352] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:17.149829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.210905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 175/353] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:17.216921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.257166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ee714-67ff-4c88-b6ab-b71e8ff516af None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.291939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.292864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.293152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.293426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.294631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.296095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.297936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 179/354] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:17.309289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.316633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50480f-d9b4-48fd-a4db-fa18bbe7f5ed None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.351799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.352696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.352984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.353255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.354449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.356493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b5571-2acf-4a37-9723-c0ab8f30d736 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.358502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 176/355] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:17.359705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359849-3084-49f8-b9ef-dc6de1af2c76 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.359985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359849-3084-49f8-b9ef-dc6de1af2c76 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.360257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00359849-3084-49f8-b9ef-dc6de1af2c76 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.365685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 177/356] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:17.367594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359849-3084-49f8-b9ef-dc6de1af2c76 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.501274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00359849-3084-49f8-b9ef-dc6de1af2c76 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.503601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d101752-76cd-4fd8-b982-c1b5d28b4dc5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.548831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.549431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.549962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.550238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.550508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.550831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.551116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.551394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.551712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.552237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:17.552593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.554033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b5afc-a2af-4ffe-9037-5dde5e0a31aa None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.554219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65439a-1d00-4583-a35c-8fa5956c81c7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.556090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 178/357] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:17.557267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fd1f-dc43-4fcd-95d0-e7266c258e6c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.557545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fd1f-dc43-4fcd-95d0-e7266c258e6c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.557818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7fd1f-dc43-4fcd-95d0-e7266c258e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.560442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 180/358] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:17.561703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54847c-3cd6-4380-ae80-1b1966f071e5 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.561983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54847c-3cd6-4380-ae80-1b1966f071e5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.562257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54847c-3cd6-4380-ae80-1b1966f071e5 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.568434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 181/359] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:17.569310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54847c-3cd6-4380-ae80-1b1966f071e5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.592744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b8d7fd1f-dc43-4fcd-95d0-e7266c258e6c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:17.593961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b8d7fd1f-dc43-4fcd-95d0-e7266c258e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:17.752237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 179/360] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:17.753979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434fec-a59e-431b-9ecb-10261e9b94c6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.754503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434fec-a59e-431b-9ecb-10261e9b94c6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.754992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77434fec-a59e-431b-9ecb-10261e9b94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.765946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54847c-3cd6-4380-ae80-1b1966f071e5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:17.799502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-77434fec-a59e-431b-9ecb-10261e9b94c6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:17.801097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-77434fec-a59e-431b-9ecb-10261e9b94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:17.818695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:17.819372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.819660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.819933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.821183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0ca399420581481588ea4f1a8441b0e1) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:17.821183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:17.822564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:17.832743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 182/361] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=752329c75e7648f4a9c9d02695370fab => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:17.833405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:17.889946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 180/362] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:17.902138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37817-5a99-4b7c-847d-b751ba8547ba None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.902873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37817-5a99-4b7c-847d-b751ba8547ba None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.902873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e37817-5a99-4b7c-847d-b751ba8547ba None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.904795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 181/363] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:17.912230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:17.912594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:17.912851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:17.942320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:17.944114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:18.010289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69ea5-ee61-4d76-8c5d-86bf1cbebb60 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.080154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.081400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.082598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.083085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.084476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 182/364] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:18.086557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.106529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:18.116045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:18.117014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 16:34:18.117815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:18.125240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 183/365] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:18.128143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.273646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b9ac3-284e-4f8d-9ba0-828b1d7c5aff None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.278417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff1c71-f9d5-4a8e-9843-0d3e95f728ab None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.332365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.333185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.333469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.333743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.341422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.342242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.342526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.342803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.352342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:18.363293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:18.364221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:18.365073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:18.367798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 183/366] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:18.368798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.376334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:18.387445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:18.388748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 184/367] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:18.389588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.523519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e49c20-51a9-45ee-b8c2-d2be90069617 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.600964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.601646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.601929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.602206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.602967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:18.603276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:18.604715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:18.608154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be41c61-c1ad-4d93-aa7d-56073ccd4a37 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.619330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 184/368] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:18.621202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.654036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.654718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.655002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.655276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.656286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:18.656597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:18.660113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:18.679954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:18.680835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.775116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed5fd-54aa-40b9-8360-85f742d58334 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.791552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4a200-b1ec-489d-8812-1d02a20891e8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:18.823114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.824908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.825193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.825471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.826226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:18.826532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:18.828526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:18.831645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:18.832580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:18.832864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:18.833141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] PATH_INFO: `/v3/users/18fb200c8bcb44d6982970a6d05b26b2` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:18.834971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] RBAC: Authorizing `identity:get_user(user_id=18fb200c8bcb44d6982970a6d05b26b2)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:18.837557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:18.839817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 186/370] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/users/18fb200c8bcb44d6982970a6d05b26b2 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:18.840667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.849321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:18.850151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:18.992436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be733c96-30f9-41aa-95c7-7467fc12bb2a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.024690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c119d1d-7c5f-4562-b44a-5ed561a3e6b6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.033878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.034544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.034833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.035112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.077156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.077845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.078137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.078418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.079326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] RBAC: Adding query filter params (role.id=1464e5118cb541829ef3997b1b11b6c9, user.id=18fb200c8bcb44d6982970a6d05b26b2, scope.system=all) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:19.079592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.081138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.100429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 186/372] 10.222.0.48 () {56 vars in 1308 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/role_assignments?user.id=18fb200c8bcb44d6982970a6d05b26b2&scope.system=all&role.id=1464e5118cb541829ef3997b1b11b6c9 => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:19.101454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:19.123926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.125575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.262839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 187/373] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:19.268525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:19.336495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7942f-965c-4efe-a720-248ca20e60ce None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.399708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d235cd0-f769-420c-9816-de88eff121c5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.426397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.427063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.427350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.427625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.457620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.458619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.458909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.459256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.465632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.467124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.469291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 188/374] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:19 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:19.474551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:19.587606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.588956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56426606-916e-4480-92e5-f532e2ee8407 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.589069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.637183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.638046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.638329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.638611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.639856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.641384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.643345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 189/375] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:19 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:19.649964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:19.802723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 187/376] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:19.808199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:19.846646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c0b3e-8bb4-4e69-a944-a130faa88843 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:19.888606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:19.889266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.889549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.889827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.890672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=0ca399420581481588ea4f1a8441b0e1) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:19.890985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:19.892468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924d431-a6a9-418e-b9a5-f549dc8fa46e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:19.898447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 190/377] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:19 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:19.918848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358117c-ff68-4180-9df5-4a9bfa3ef125 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.919181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358117c-ff68-4180-9df5-4a9bfa3ef125 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.919439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358117c-ff68-4180-9df5-4a9bfa3ef125 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.921149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 191/378] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:19.927921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:19.928210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:19.928560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:19.950689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:19.952113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:20.000763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b900a51-d0aa-41c8-ae2a-534e26c23d5d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.037918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 192/379] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:20.059619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.060521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.060804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.061079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] PATH_INFO: `/v3/projects/18061f9244ab48daafb61d27ac0a0610` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.062298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] RBAC: Authorizing `identity:get_project(project_id=18061f9244ab48daafb61d27ac0a0610)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.063879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.066033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 188/380] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:19 2022] GET /identity/v3/projects/18061f9244ab48daafb61d27ac0a0610 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:20.071302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.083942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.211750 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dd19e-b9e3-4478-8669-7ff057b95e01 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.224206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b778b3-099c-4da2-8db8-236c5031d1c3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.253057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.253865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.254151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.254426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.261925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.263108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.263595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.264070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] PATH_INFO: `/v3/groups/2636a8127f2943888d093e6488f24b98` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.269397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:20.270656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] RBAC: Authorizing `identity:get_group(group_id=2636a8127f2943888d093e6488f24b98)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.272330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.274533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 193/381] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/groups/2636a8127f2943888d093e6488f24b98 => generated 229 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:20.280095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:20.282739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:20.283628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:20.284467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 189/382] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:20.289702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.393970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a9b40-8c0f-4db1-b9ce-4dcb2241e1d8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.429305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.430335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.430822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.431298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.432380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] RBAC: Adding query filter params (group.id=2636a8127f2943888d093e6488f24b98, role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=18061f9244ab48daafb61d27ac0a0610) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:20.433314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.434983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.441228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 194/383] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/role_assignments?group.id=2636a8127f2943888d093e6488f24b98&scope.project.id=18061f9244ab48daafb61d27ac0a0610&role.id=1b495dbb303447258ed6e7db6e67280f => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:20.474854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da003428-3113-43a0-bf7a-0a0a7bed9754 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.520991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.522070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.522661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.523162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.524157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:20.524727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.526396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.540440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 190/384] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:20.547250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.659725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67faa8-bd84-4ce4-b293-7853486c289d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.697284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.698184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.698465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.698784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.700101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.701682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2166e87-045f-4c8d-842e-7d6e3a42db3f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.703679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 195/385] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:20.709212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.720907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e373b-ec28-4404-a290-a9b666083939 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.721241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e373b-ec28-4404-a290-a9b666083939 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.721469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e373b-ec28-4404-a290-a9b666083939 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.722949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 196/386] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:20.730853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.731178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.731460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.752510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:20.753709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:20.827503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 197/387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:20.832496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332073c5-c18e-420f-99a0-57aed77dfc21 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:20.873447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.873701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:20.874640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:20.874926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:20.875194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:20.876468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:20.878495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:20.880020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 191/388] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:20.886784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:20.996718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7994f7-2e1a-4324-8f75-11786059415b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.037920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.038990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.039342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.039680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/groups/741741b8104a4b70ae9c474fcb80d45f/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.048394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, group_id=741741b8104a4b70ae9c474fcb80d45f, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.050150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.081325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 192/389] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 10 16:34:20 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/groups/741741b8104a4b70ae9c474fcb80d45f/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:21.087682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5cb8-5fe0-4e27-8867-62ca84bf5491 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.131712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.132578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.132862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.133187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.148368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-a8574d4a-c15e-4446-8693-fc29eeb6e7fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:21.157419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:21.158363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:21.159138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:21.164309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 198/390] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:21.164677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.266936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99bce-e536-4ffc-8061-f30ea2e04228 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.267874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99bce-e536-4ffc-8061-f30ea2e04228 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.268396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99bce-e536-4ffc-8061-f30ea2e04228 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.269978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 199/391] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:21.277693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.278317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.278783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.278883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8eaa-152c-423f-ba92-23ff27ff2b38 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.298045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:21.299905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:21.316904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.317549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.317840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.318288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.319071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:21.319353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.320914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.329680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 193/392] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:21.335105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.392288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 200/393] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:21.409648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.457231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ee8a9-6855-48c4-a73b-942164fa3341 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.491946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.493089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.493521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.493977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.495320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.498196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.500336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 194/394] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:21.506871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.512199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3274-99de-491f-8187-9d74ae10dc2e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.553032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.554159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.554648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.555133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.565712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:21.578900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:21.579773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:21.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:21.587633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 201/395] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:21.589783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.617204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e19f-7e57-4bd3-963c-5b6989ee8553 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.656218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.657410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.657887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.658335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.659880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.661682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.663939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 195/396] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:21.672303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.702908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e36179-a6f1-4b36-973a-76cc5259399b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.740964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.741682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.741965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.742289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.743034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] RBAC: Adding query filter params (name=member) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:21.743333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.744825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.758299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 202/397] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:21.760539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:21.797617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d135bee-afb7-4a61-b82a-b75c8757a6f0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.847593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.848434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.848878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.849390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/groups/741741b8104a4b70ae9c474fcb80d45f/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.851840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=42fd68fdf06d4dea8e98c2562adb3db0, group_id=741741b8104a4b70ae9c474fcb80d45f, role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.854000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.872438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 196/398] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 10 16:34:21 2022] PUT /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0/groups/741741b8104a4b70ae9c474fcb80d45f/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:21.891641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd9e9-94bd-4e34-b40e-4b0a885c0286 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:21.939614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:21.940822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:21.941260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:21.941702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:21.943150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:21.944892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:21.948229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 203/399] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:21.954478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:22.075820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe38e-2358-42fc-81a0-1c4dc379a5a4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:22.120088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:22.121033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:22.121322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:22.121599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:22.129244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:22.130743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a46f7-f52e-4339-803e-d45c8d2d0e6c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:22.132925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 197/400] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:21 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:22.139134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:22.267301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3db7db-792f-4258-9acd-af16ddabaa22 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:22.306282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:22.307169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:22.307501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:22.307778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/groups/741741b8104a4b70ae9c474fcb80d45f/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:22.311745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, group_id=741741b8104a4b70ae9c474fcb80d45f, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:22.313243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c39c48-7d12-499d-aaa6-f0b0b70a1653 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:22.338648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 204/401] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 10 16:34:22 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/groups/741741b8104a4b70ae9c474fcb80d45f/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:23.190664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a04d2-f31f-44ba-9b66-2465ebdb1379 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.191160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a04d2-f31f-44ba-9b66-2465ebdb1379 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.191233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a04d2-f31f-44ba-9b66-2465ebdb1379 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.192603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 198/402] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:23.214115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe12-5ddf-4a15-a574-744aec267766 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.214951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe12-5ddf-4a15-a574-744aec267766 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.214951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe12-5ddf-4a15-a574-744aec267766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.236472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5c2dbe12-5ddf-4a15-a574-744aec267766 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:23.237669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5c2dbe12-5ddf-4a15-a574-744aec267766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:23.329010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 205/403] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:23.362048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a04d2-f31f-44ba-9b66-2465ebdb1379 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:23.474845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bca17-f04a-406b-87be-918de5be26ed None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.475138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bca17-f04a-406b-87be-918de5be26ed None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.475327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bca17-f04a-406b-87be-918de5be26ed None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.476989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 206/404] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:23.482687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.482977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.483256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.502138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a04d2-f31f-44ba-9b66-2465ebdb1379 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:23.509745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:23.513172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:23.579468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:23.580306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.581237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.581237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.601769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:23.612932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:23.613863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:23.614641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 199/405] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:23.630582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 207/406] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:23.638372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:23.697385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:23.810515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e5c99-8051-4681-8336-5797679e8534 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:23.835783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fec02-fd98-438f-9b67-bb17de68f577 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:23.883534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:23.884256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.884570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.884846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.885602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:23.886419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:23.887810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:23.901402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 200/407] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:23.907755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:23.914478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:23.915280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:23.915558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:23.915836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:23.940863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:23.951189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:23.952064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:23.952893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 208/408] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:23.958180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.054478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9489-8115-4432-b793-b980d16bb093 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.091996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.093352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.093998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.094499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.095882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.097905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.104493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 201/409] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:23 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:24.106866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.225916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba7911-0e47-43a0-9cbb-e383e595c2d7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.226521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b237499-2215-42b2-a6cb-dcafe71b45ab None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.263294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.264551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.265049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.265520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.266926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.268686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.271034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 202/410] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:24 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:24.277872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.280135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.280847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.281401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.281681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.282440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:24.282751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.284461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.301360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 209/411] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:24.306618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.387205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe05a2-f551-40d8-b81a-5dfa464f4ace None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.419379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3a087-0c3f-436f-9ded-c32d68086d2f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.422718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.423880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.424655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.425126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1/groups/741741b8104a4b70ae9c474fcb80d45f/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.427568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca399420581481588ea4f1a8441b0e1, group_id=741741b8104a4b70ae9c474fcb80d45f, role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.429281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cb777-a7e4-4606-9b3a-2af435a5d018 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.455435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 203/412] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 10 16:34:24 2022] PUT /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1/groups/741741b8104a4b70ae9c474fcb80d45f/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:24.458031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.458896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.459182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.459467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] PATH_INFO: `/v3/groups/2636a8127f2943888d093e6488f24b98` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.460701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] RBAC: Authorizing `identity:get_group(group_id=2636a8127f2943888d093e6488f24b98)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.460873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c713-d9cc-4977-b6df-3f91ac9334d9 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.461160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c713-d9cc-4977-b6df-3f91ac9334d9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.461434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c713-d9cc-4977-b6df-3f91ac9334d9 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.462147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.463142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 204/413] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:24.463948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 210/414] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:24 2022] GET /identity/v3/groups/2636a8127f2943888d093e6488f24b98 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:24.469677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.469893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.469973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.470259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.509458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:24.510674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:24.581276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa2d64-0605-4d48-97b2-db2f9aabaebe None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.616766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.617641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.617926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.618206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] PATH_INFO: `/v3/projects/18061f9244ab48daafb61d27ac0a0610` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.619507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] RBAC: Authorizing `identity:get_project(project_id=18061f9244ab48daafb61d27ac0a0610)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.621577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.623472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 211/415] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:24 2022] GET /identity/v3/projects/18061f9244ab48daafb61d27ac0a0610 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:24.628904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.703262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 205/416] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:24.731317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.738216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde15d5-30d9-4b30-a05a-1589f8e8f572 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.781985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.783084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.783366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.783643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] PATH_INFO: `/v3/projects/18061f9244ab48daafb61d27ac0a0610/groups/2636a8127f2943888d093e6488f24b98/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.786336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] RBAC: Authorizing `identity:create_grant(project_id=18061f9244ab48daafb61d27ac0a0610, group_id=2636a8127f2943888d093e6488f24b98, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:24.788221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c485887-e47a-4009-8537-463ef6b1078a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:24.816206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 212/417] 10.222.0.48 () {58 vars in 1442 bytes} [Tue May 10 16:34:24 2022] PUT /identity/v3/projects/18061f9244ab48daafb61d27ac0a0610/groups/2636a8127f2943888d093e6488f24b98/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:24.859286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab8656-53a5-478f-96bd-06f8f8b00d7c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:24.899891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:24.901099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.902218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.902764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.914236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f8cf-9c29-4af4-80c0-872d25985cdd None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.914560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f8cf-9c29-4af4-80c0-872d25985cdd None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.914791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24f8cf-9c29-4af4-80c0-872d25985cdd None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.915412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:24.917918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 213/418] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:24.922390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:24.922694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:24.922955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:24.925553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:24.926471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:24.927300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:24.930199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 206/419] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:24.940410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:24.963538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:24.964875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:25.094421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 214/420] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:25.122695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.125201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f764e4-a2dd-4134-8610-212eb5a80e93 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.171168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.171842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.172120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.172425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.173186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:25.175271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.175271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:25.188124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 207/421] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:25.189373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.285827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484c3eb-5bd3-4949-a7c4-b8c50edce889 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.288088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d21d10-a72e-4800-b94a-581ca22629a6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.330547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.332429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.332717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.332991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.334935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.335754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.336034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.336327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.367414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:25.382459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:25.383423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:25.384224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 215/422] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:25.405679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.433006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.434596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca84cc-3972-4622-a286-68154fd1a3d7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:25.536079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 208/423] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:25.540600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19415-0069-47fe-b273-b82fc820a7a8 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.540600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19415-0069-47fe-b273-b82fc820a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.540600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda19415-0069-47fe-b273-b82fc820a7a8 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.540600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 209/424] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:25.542620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19415-0069-47fe-b273-b82fc820a7a8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.599404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77547b9-8175-4777-a525-c0be9fa70e8d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.643315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.644305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.644680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.645536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.646579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:25.646891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.648765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fd3a3-42cd-48f1-86fa-9b02a9dcdc62 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:25.661623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 216/425] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:25.662981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.663271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.663555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.675471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda19415-0069-47fe-b273-b82fc820a7a8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.684406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:25.686235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:25.716552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.718192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.718529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.718959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.720724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.722266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:25.724404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 210/426] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:25.725171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.765022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 217/427] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:25.766022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.857915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac70904-a815-41a5-b242-c8c51cd48eae None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.894730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff942a-3535-4d25-94c2-454312c7f802 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:25.896635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.897295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.897579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.897854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.934920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:25.935813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:25.936091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:25.936416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:25.937631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.939154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:25.945618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 218/428] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:25.946641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:25.971991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:25.973485 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.059776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b686a-4414-46aa-b904-d18f2a90fe2e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.078910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:26.079774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.102547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.103751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.104032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.104447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.116225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:26.124564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:26.126671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 219/430] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:26.128795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.190967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b7bdf-99e4-41d2-9895-8932fc6cdc5c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.226876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.227534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.227818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.228093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.229121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:26.230110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.231602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.238146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771ade6-6562-4558-8102-6064edd745c0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.238446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 212/431] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=752329c75e7648f4a9c9d02695370fab => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:26.239391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.317878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.318755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.319034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.319306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] PATH_INFO: `/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.321034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] RBAC: Authorizing `identity:get_project(project_id=42fd68fdf06d4dea8e98c2562adb3db0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.322504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.327960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 220/432] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/projects/42fd68fdf06d4dea8e98c2562adb3db0 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:26.332621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.355115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65332a-cd4e-4d7a-9aab-08fd9938d006 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.393581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.394230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.394521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.394800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.395571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] RBAC: Adding query filter params (name=member) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:26.395877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.397474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.407557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 213/433] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:26.413537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.477326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51489f-51dd-4129-8331-3d4568421475 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.529491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.535745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.535745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.535745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.535745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.536483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.540550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 221/434] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:26.549371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d4a-5442-4672-8add-e8431f4a055c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.561332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.587900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.588628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.588946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.589226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.707791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.709584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.734391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05313097-5e9c-4c03-9182-d82490a4ce02 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.777243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.778195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.778835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.779120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.780252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:26.780604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.782789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:26.791853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 222/435] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=42fd68fdf06d4dea8e98c2562adb3db0&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:26.830894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 214/436] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:26.836117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:26.948240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5fec3-6e44-421a-bb05-25258977f898 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:26.993025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:26.994365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:26.994879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:26.996113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:26.997898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:26.999692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.002227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 223/437] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:26 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:27.007826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.126532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be55d-ea33-4bd2-bf5e-e4cc52f77f20 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.159488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.160374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.160660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.160933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.162105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:27.163545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db0c91-a9ad-4ab5-b844-ebf1aaf92b7d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.165508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 215/438] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:27.171914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.215831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f48f4-ef7c-4a33-ae73-ec3eeb6a0cfe None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.216119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f48f4-ef7c-4a33-ae73-ec3eeb6a0cfe None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.219292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f48f4-ef7c-4a33-ae73-ec3eeb6a0cfe None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.220886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 216/439] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:27.226221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.226512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.226842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.246213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:27.247321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:27.278659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46ca6a-e8dc-44cc-a4d0-dd04b92c688d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.320926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.321943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.322420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.322870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.324399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=752329c75e7648f4a9c9d02695370fab, scope.project.id=0ca399420581481588ea4f1a8441b0e1) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:27.324916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:27.326560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad707b2d-b67c-46b9-be47-e2d1273b4bee None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.330568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 217/440] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:27.333502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 224/441] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=752329c75e7648f4a9c9d02695370fab => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:27.357404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.470317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388bdcf2-54c6-45c8-b3ce-322cebdce5e6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.493281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dc0-1fd6-4de0-a7dc-db9347ee8c9c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.493572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dc0-1fd6-4de0-a7dc-db9347ee8c9c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.493848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498dc0-1fd6-4de0-a7dc-db9347ee8c9c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.495942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 225/442] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:27.502223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.502391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.502685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.512981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.513812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.514095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.514369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.524772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:27.525970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:27.526934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:27.538342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:27.539244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:27.544878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 218/443] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:27.547245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.607223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 226/444] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:27.630563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.666328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be355a-ff73-4522-a78c-29f318979382 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.705092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.705757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.706111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.706378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.707037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:27.707336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:27.709422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.717799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 219/445] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:27.722854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.751247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0141-f06c-4dc4-a984-0e394f87c9e1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.783667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.784405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.784683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.784949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.794523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:27.802266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:27.803327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:27.804161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 227/446] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:27.809244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:27.822618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054474af-2212-4415-a5b3-03dd8f2c2041 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.854485 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.855819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.856107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.856418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.902858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffd252-f100-4ef1-b75d-bc021383fe68 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:27.918889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:27.920404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.935474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:27.936125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:27.936454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:27.936737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:27.937483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:27.937791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:27.939146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:27.946828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 228/447] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:27.952857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.012184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 220/448] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:28.017635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.046313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417f5e5-3c2d-481e-a03e-2fbbf72fa861 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.078788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.079420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.079701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.079977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.110981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a545f58-a018-4faf-9988-61a67900e246 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.142961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.143813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.144091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.144395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] PATH_INFO: `/v3/projects/0ca399420581481588ea4f1a8441b0e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.145570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca399420581481588ea4f1a8441b0e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.146121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.147006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.147560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.148925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 221/449] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/projects/0ca399420581481588ea4f1a8441b0e1 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:28.154537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.243443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 229/450] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:34:28.247529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c06ec-4114-410a-ae7a-aaf5f13a5514 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.249793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.279740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.280609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.280891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.281161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] PATH_INFO: `/v3/groups/741741b8104a4b70ae9c474fcb80d45f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.282393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] RBAC: Authorizing `identity:get_group(group_id=741741b8104a4b70ae9c474fcb80d45f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.283827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.285451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 222/451] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/groups/741741b8104a4b70ae9c474fcb80d45f => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:28.291058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.341691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd9538-02b7-4623-bca6-23caba83ef35 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.373453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.374301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.374582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.374858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] PATH_INFO: `/v3/projects/18061f9244ab48daafb61d27ac0a0610` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.376028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] RBAC: Authorizing `identity:get_project(project_id=18061f9244ab48daafb61d27ac0a0610)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.377498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.379160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 230/452] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/projects/18061f9244ab48daafb61d27ac0a0610 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:28.384457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.385465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee17d-cfd6-4fc5-9b10-b35753b6acb5 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.419698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.420376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.420666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.420943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.421769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] RBAC: Adding query filter params (group.id=741741b8104a4b70ae9c474fcb80d45f, role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=0ca399420581481588ea4f1a8441b0e1) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:28.422084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.423519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.429401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 223/453] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/role_assignments?group.id=741741b8104a4b70ae9c474fcb80d45f&scope.project.id=0ca399420581481588ea4f1a8441b0e1&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:28.482950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add1d77-ee70-49ee-8896-45253627e414 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.518495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.519361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.519644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.519921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] PATH_INFO: `/v3/groups/2636a8127f2943888d093e6488f24b98` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.521189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] RBAC: Authorizing `identity:get_group(group_id=2636a8127f2943888d093e6488f24b98)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.522660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f92df1-8809-4527-a71f-57b7554d2927 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.524333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 231/454] 10.222.0.48 () {56 vars in 1180 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/groups/2636a8127f2943888d093e6488f24b98 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:28.530358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:28.633900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751d2e2-ecc9-45b9-bd4a-1377fc2eadca None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:28.666616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:28.668009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:28.668383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:28.668670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:28.669515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] RBAC: Adding query filter params (group.id=2636a8127f2943888d093e6488f24b98, role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=18061f9244ab48daafb61d27ac0a0610) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:28.669833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:28.671283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2de40-32d3-44e0-ba3a-a342ed4cac42 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:28.677950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 224/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue May 10 16:34:28 2022] GET /identity/v3/role_assignments?group.id=2636a8127f2943888d093e6488f24b98&scope.project.id=18061f9244ab48daafb61d27ac0a0610&role.id=1b495dbb303447258ed6e7db6e67280f => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:31.735974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c836d7-4901-4e43-8f5d-fd3bf88bcb7c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:31.735974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c836d7-4901-4e43-8f5d-fd3bf88bcb7c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:31.735974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c836d7-4901-4e43-8f5d-fd3bf88bcb7c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:31.737077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 232/456] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:31.742022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b988e8-0eff-42c5-a8c6-be26f3349ae2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:31.742850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b988e8-0eff-42c5-a8c6-be26f3349ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:31.743338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b988e8-0eff-42c5-a8c6-be26f3349ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:31.768841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c7b988e8-0eff-42c5-a8c6-be26f3349ae2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:31.770376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c7b988e8-0eff-42c5-a8c6-be26f3349ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:31.859855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:31.862364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3c8b-cbf9-4bb0-ac05-fe5a0f41fc72 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:31.862653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3c8b-cbf9-4bb0-ac05-fe5a0f41fc72 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:31.862934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c3c8b-cbf9-4bb0-ac05-fe5a0f41fc72 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:31.868342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 233/458] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:31.884298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6347b-eb5f-491b-a915-689483150e0a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:31.884298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6347b-eb5f-491b-a915-689483150e0a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:31.884298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6347b-eb5f-491b-a915-689483150e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:31.907974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3c8b-cbf9-4bb0-ac05-fe5a0f41fc72 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:31.942814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a5a6347b-eb5f-491b-a915-689483150e0a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:31.943980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a5a6347b-eb5f-491b-a915-689483150e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:32.092299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 226/459] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d729-5e8b-4ef6-ae60-5c9cbde60ea8 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d729-5e8b-4ef6-ae60-5c9cbde60ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d729-5e8b-4ef6-ae60-5c9cbde60ea8 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 227/460] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.105170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.105945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.108363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c3c8b-cbf9-4bb0-ac05-fe5a0f41fc72 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.135173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:32.137698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:32.150414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.152073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.152851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.153389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.164994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.166928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:32.190295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:32.191275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:32.192176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:32.192176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:32.192176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.192176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:32.200035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 234/461] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:32.201485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.228397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 228/462] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:32.230916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.321557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75952bbf-aa5b-427c-aa66-ff1c0350aae9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.352181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986706-8da1-4350-86ea-cbe36c44d74a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.366504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.368056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.368534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.368982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.380947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.382463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.393100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.393820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.394176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.394531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.395342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:32.395652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.397866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1be928-cc05-4e70-b48a-219ea00f2d5d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:32.402865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:32.403743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:32.404719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:32.404719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:32.404719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.404719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:32.404719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 235/463] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:32.405006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.427268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 229/464] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:32.427268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654094-f0c5-4191-b57f-1842e5e30616 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.427268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654094-f0c5-4191-b57f-1842e5e30616 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.427268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b654094-f0c5-4191-b57f-1842e5e30616 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.429087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 230/465] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:32.429694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654094-f0c5-4191-b57f-1842e5e30616 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.532406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ba3d2-00e1-4cf7-ba5d-01cbaec7d804 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.558900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b654094-f0c5-4191-b57f-1842e5e30616 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.579892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.581290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.581973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.582356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.595002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.596603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.607513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.608501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.608988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.609468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.610223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:32.610540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.611923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec15a1-5d85-4960-b44d-b01f26151799 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:32.619460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:32.620929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:32.621832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:32.621832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:32.621832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:32.621832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:32.621832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 236/466] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:32.622093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.631612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 231/467] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:32.633012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.633306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.633589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.654160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:32.656625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:32.725237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 232/468] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:32.726069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.752411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01426c96-cdf5-42db-aeae-4f0d4275a35e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.788479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.789146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.789430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.789702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.790393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.791896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.820466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 237/469] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:32 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:32.821432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.839150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237afa6-45ce-4825-beb6-d22b7caf9cf7 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.883420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.883420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.883724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.883794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.884562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:32.884873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.886388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616fbcb-d832-4eaa-ada1-b2d869d9a616 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:32.904980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 233/470] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:32.904980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ff8b-b846-4540-92d9-05a11b468eff None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.904980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ff8b-b846-4540-92d9-05a11b468eff None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.904980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ff8b-b846-4540-92d9-05a11b468eff None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.907209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 234/471] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:32.908630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ff8b-b846-4540-92d9-05a11b468eff None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:32.948848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85faf2-9d1b-4ae7-9999-dcb8dbc80bd7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:32.985965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:32.986348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:32.986640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:32.986932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:32.987830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:32.989545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.016559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 238/472] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:32 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:33.017772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.049826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ff8b-b846-4540-92d9-05a11b468eff None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.122241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.122241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.122241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.122597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.143935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.148302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-776e9162-ca56-4202-b978-d08e81f725f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:33.182747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:33.183654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:33.185023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:33.185023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:33.185023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:33.185023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.185023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 235/473] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:33.185296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbaf51-f685-4485-b409-8209fa774199 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.190666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.190947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.191225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.222974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:33.223622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:33.229212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.232331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.232331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.232331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.232331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.232830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.262274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 239/474] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:33 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:33.263211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.324528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 236/475] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:33.351199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.426330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174c51-8c34-412f-90d0-5cae85acf69d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.463093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.463696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.464056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.464365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.466124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:33.466435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.467862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.480305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169fd49-9b0e-4d98-a165-cb4a72adefed None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.481731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 240/476] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:33.486797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.517123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.517830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.518286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.518566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.519499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.524297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.535481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.sql.core [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:34:33.535481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 16:34:33.535481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [parameters: {'id': 'a435198a32dd4b20a1ca1d10c362546e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 16:34:33.535481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application conn.query(q) May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result.read() May 10 16:34:33.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return ref.to_dict() May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:34:33.554740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application next(self.gen) May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application yield resource May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application next(self.gen) May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise self.value May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application session.commit() May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:34:33.555712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.session.flush() May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application compat.raise_( May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:34:33.556967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:34:33.564601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application conn.query(q) May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result.read() May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:34:33.566773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [parameters: {'id': 'a435198a32dd4b20a1ca1d10c362546e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:33.568719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 16:34:33.571149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.573959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 237/477] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 10 16:34:33 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:33.573959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.641570 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b83526-0b9b-4794-aa28-40672840a9fb None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.699481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.699871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.700108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.700419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.702075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.703323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.711010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa333276-51cb-4224-b17b-213f15b6c1d1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.726988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 241/478] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:33 2022] POST /identity/v3/users => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:33.767427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.768238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.768976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.769263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.782611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d3075cbe-c6dc-4b01-9f4d-0f776c960bbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:33.790989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:33.792107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:33.792988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 238/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:34:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:33.800209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:33.928035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331f5b8-9bdf-4102-9f5a-71c9d91783f4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:33.974746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:33.975435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:33.975720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:33.975995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:33.976796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:33.977148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:33.978481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29585-1e5f-4f96-b516-a2538e485481 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:33.996416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 242/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:35.837208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8bd9f-a90a-40ab-abc5-5ca357001f6c None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:35.837208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8bd9f-a90a-40ab-abc5-5ca357001f6c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:35.837208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8bd9f-a90a-40ab-abc5-5ca357001f6c None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:35.838301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 239/481] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:35.849951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:35.850400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:35.850495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:35.883494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:35.884713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:35.949816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663313-3d07-4860-b315-5affeb4497de None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:35.950436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663313-3d07-4860-b315-5affeb4497de None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:35.950914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1663313-3d07-4860-b315-5affeb4497de None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:35.952859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 240/482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:35.965220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:35.966861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:35.967409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:35.988163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 243/483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:36.025462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:36.027086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:36.029190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.184306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 241/484] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:36.212970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99d1e0-7bbc-4bba-856c-1bc1a073bd89 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.252331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.271744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.276293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.276293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.276293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.291550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:36.301906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:36.302826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:36.303620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 244/485] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:36.309681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.396214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba0bad-fe78-4ef7-a321-958ef485e223 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.435653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.436810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.437299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.437794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.449228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e59558f9-264b-429d-8436-a3e8e843177d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:36.458243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:36.459136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.459921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:36.462898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 242/486] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:36.465472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-943d-4cc0-a15d-da45d3748331 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.466393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-943d-4cc0-a15d-da45d3748331 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.466910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225fa07-943d-4cc0-a15d-da45d3748331 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.470564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 243/487] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:36.471538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fa07-943d-4cc0-a15d-da45d3748331 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.471944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505b5e3-9fcc-4d47-aa19-1799011b9365 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.512476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.513150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.513445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.513702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.514454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:36.514760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:36.516136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31623c13-8a6f-4660-820e-0772cc9591b1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:36.533165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 245/488] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:36.537133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.538890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.538890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.563104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:36.564303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:36.639431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225fa07-943d-4cc0-a15d-da45d3748331 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.662895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 246/489] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:36.663546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.695189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.696205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.697791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.698817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.701463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:36.701991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:36.703622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:36.721926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:36.723193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.802471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395394d9-aa26-4553-ad9f-847afbdcd899 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.840120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.840932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.841216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.841603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.851220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ebac4-b024-47ff-b6b9-1c2a89140c46 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:36.852014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:36.853777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:36.873271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:36.874193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:36.875015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:36.875015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:36.875015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:36.875015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:36.875015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 247/491] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:36.877329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.896175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:36.899264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:36.899783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:36.900319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:36.914406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:36.927635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:36.928604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:36.929393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:36.932127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 245/492] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:36.933938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:36.993986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67c6e-26b0-4c14-b634-086206907a61 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.033828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.034622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.034902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.035170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.054679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.055443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.080240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bacc7d-1b2e-4fdc-8733-c24002903fec None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:37.081968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:37.082794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:37.083642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:37.083642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:37.083642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:37.083642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:37.083642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 248/493] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:37.089264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.144067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.145192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.145706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.146184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.147462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.148028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.149855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.166189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:37.168233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.215908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddf7-de2b-45b2-8753-6ced0d67e0af None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.251961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.252611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.252890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.253162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.253910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.254211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.255581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.265954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 249/495] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:37.266847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.320402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3995-539f-42b0-b34d-afdc5e10313e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.360996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.361667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.361949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.362229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.362959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.363265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.364675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.377538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 247/496] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:37.378387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.392233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a45a5-ef3f-40ef-ac54-55d0b5736b41 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.427548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.428634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.428914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.429188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] PATH_INFO: `/v3/users/glance` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.437908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.439341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8eab2e35-3721-4317-9998-a34288f99a5d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:37.455020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:37.455967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:37.456894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 250/497] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:37.458350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c12c8-aa4b-4d5e-9079-b898c8439d45 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.458350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c12c8-aa4b-4d5e-9079-b898c8439d45 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.458350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c12c8-aa4b-4d5e-9079-b898c8439d45 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.460317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 251/498] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:37.460665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e94b-85f7-4e75-92ea-8aeb79143998 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.461120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e94b-85f7-4e75-92ea-8aeb79143998 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.461399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170e94b-85f7-4e75-92ea-8aeb79143998 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.463420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 252/499] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:37.464149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170e94b-85f7-4e75-92ea-8aeb79143998 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.494317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c68248-51b8-4ace-a82b-d0beb6c03493 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.530497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.532296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.532751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.533316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.547752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.549663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:37.567437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:37.568431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 248/500] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:37.573614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.574208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170e94b-85f7-4e75-92ea-8aeb79143998 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.612074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.612900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.613176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.613447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.621654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.623126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-818ade40-9a3b-4a87-ab40-72651d185ea3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:37.638237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:37.639181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:37.640064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 253/501] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:37.641366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a5ca4-5a31-4994-81e7-a1b313efd0fe None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.641779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a5ca4-5a31-4994-81e7-a1b313efd0fe None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.642245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a5ca4-5a31-4994-81e7-a1b313efd0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.664316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-421a5ca4-5a31-4994-81e7-a1b313efd0fe None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:37.665868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-421a5ca4-5a31-4994-81e7-a1b313efd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:37.677862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23480af1-e87d-46a0-a53c-0b835579680a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.716194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.716905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.717182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.717456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.718339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.718608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.720055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.735577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 254/502] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:37.736910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.737197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.737473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.754877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:37.756138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:37.763393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 249/503] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:37.763393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.840399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 255/504] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:37.840399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.869294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a56fb-2784-4021-be1d-9eef3305557c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.904726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.905383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.905665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.905936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.906652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.906956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.908592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:37.920261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 250/505] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:37.925587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:37.940987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fab0a-2367-4e30-a22a-4544d8fa5685 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:37.975217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:37.975895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:37.976181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:37.976517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:37.977355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:37.977669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:37.979101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.016625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 256/506] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:38.017753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.033067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331490c4-0e44-4ce2-83cf-a5ca51baa489 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.068979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.069686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.069970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.070242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.080927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.082595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:38.103392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:38.104347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:38.105244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:38.105244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:38.105244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:38.105244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:38.105452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 251/507] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:38.106074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.130968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95986-07eb-49c0-b3c6-d8496c25669b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.167393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.168041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.168352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.168628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.215958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0db5-8932-45fe-ab24-380f39b78f6c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.245646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.246361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.249309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.250105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.250393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.250672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.262165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:38.270354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:38.271286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:38.272067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:38.273004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.352564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 257/509] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:38.353465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.382963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a02b7-deae-4a1f-89ae-2e69dbacb379 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.419260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.420367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.420657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.420929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.429070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.430519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:38.446546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:38.447453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:38.448528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:38.452416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 253/510] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:38.453273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.457522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873b59e-590e-4214-9620-7b8458752646 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.497765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.498459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.498747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.499025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.564758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6f1a1-dbf6-4042-b78b-53e7e3bd885b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.571778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.574899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.603409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.604141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.605046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.605046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.605617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:38.605925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.607336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.622468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 254/511] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:38.623346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.689865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 258/512] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:38.690798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.736256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0060-28ef-4c7a-87a6-c094df605c2f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.774654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.776353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.776353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.776353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.777415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:38.777731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.779680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.788081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 255/513] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:38.788931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.799416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be90149-b8bb-40f8-9404-6fc61550dde0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.834232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.835109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.835387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.835659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.846154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.847525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:38.865743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:38.866636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:38.867491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:38.867491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:38.867491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:38.867491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:38.867491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 259/514] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:38.867892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.890336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1249cf3-5109-4c62-8160-27bcc530b3a2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:38.931506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:38.933213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:38.933862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:38.933862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:38.934645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:38.934956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:38.937349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:38.958832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 256/515] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:38.958832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:38.979809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6790-2812-4e23-b89d-2f4e683ab16f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.015718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.016526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.016881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.017225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.018078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.019707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.040063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 260/516] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:38 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:39.040929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.069447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d3f30-e53d-4e96-9afb-6e069bafe760 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.114137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.115219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.115668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.116154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.130106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.132044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:39.154968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:39.155871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:39.156745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:39.156745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:39.156745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:39.156745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:39.163765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 257/517] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:39.165078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.168474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af9779-f48d-46fc-8a44-840bab0d1fff None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.205607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.206542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.206731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.206958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.219322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.220854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:39.243434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:39.244546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 261/518] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:39.246116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.306951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8da6e-489a-4710-996b-b43895a131d1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.348870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.350874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.351160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.351437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.352942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:39.352942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.353968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.366752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 258/519] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:39.367876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.376585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc79a3c-3604-4f97-97e6-600e40886f59 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.419730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.420566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.420858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.421138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.503070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a5cb-149e-40a7-8097-fba470b8550c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.520843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.523318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.547164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.548202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.549516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.549862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.550656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:39.551048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.552386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.571012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 259/520] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:39.577680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.652407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 262/521] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:39.652407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.709484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d8b64-bfc2-4281-be92-f4bdd6063d75 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.751413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.752236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.752560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.752839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.753567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:39.753872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.755417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.772330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 260/522] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:39.772330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.775681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee30c4-2864-4224-b6d3-1c279ca5565b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.816845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.817937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.818222 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.818494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.827337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.829033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:39.845797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:39.846688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:39.847535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:39.855211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 263/523] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:39.856404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.893546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ebfc-c7e0-4bb7-87f2-8b8a40528f8b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:39.928475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:39.929221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:39.929569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:39.929819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:39.937291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:39.938829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:39.955453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:39.956780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 261/524] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:39.958068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:39.966755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3a333-9dec-48cd-865d-4e2817c886de None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.001851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.003424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.003938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.004464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.016119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.018036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:40.036355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:40.037255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:40.038128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:40.038128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:40.038128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:40.038128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:40.040546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 264/525] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:40.041648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.062367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a244a8-d007-4409-a38e-ea718f3eb51f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.109078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.110031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.110320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.110818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.121886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.123516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:40.145772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:40.146717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:40.148010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:40.153442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.159498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415804ea-9e8b-41ff-9299-a04529920c1a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.202210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.203103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.203736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.204144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.205101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.205552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.207220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.227345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 265/527] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.228628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.266711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7602aa-f9c8-475a-813b-bb36f9ba5c72 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.305511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.306206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.306491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.306760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.308106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.308861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.310312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.330436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 263/528] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.336136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.351163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93160270-bf56-4a7a-b105-dbec4993a6e8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.402334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.403016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.403307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.403590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.404344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.404681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.406030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.423195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 266/529] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.423195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.469279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d969c6-9002-490c-9189-83d0f6b2a89d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.511820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.512787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.513213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.513631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.514623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.515075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.516887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.542592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.544225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.546821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e7b2c-6226-4b12-9500-0c14a421773e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.599640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.600106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.600443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.600728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.601565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=64b24a8c20fd44f99cd7d961c259ce0a) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.601882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.603386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.610059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/role_assignments?user.id=64b24a8c20fd44f99cd7d961c259ce0a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.611516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.675259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275fe5-5c54-4991-b430-a4c72c5b5b0a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.725564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.726520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.726983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.731273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.732490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:40.733011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.734676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.748049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:40.753610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:40.857853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da807d-6996-4c54-80b6-e8c9456c7204 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.891786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9978ae9-e7e5-4e00-b1a2-d37d4a0e2845 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:40.934267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.935968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.936821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:40.938030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:40.938526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.938967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.939414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:40.940612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:40.958320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:40.960128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:40.984219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:40.985125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:40.985969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:41.005358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:41.017542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.095368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:41.099506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:41.222651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cad3ee-0fca-40e6-a308-c008fbc76883 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:41.246699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 266/534] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:41.252444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.298467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:41.299717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.300176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.301544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.302525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:41.303020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:41.306844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:41.333019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:41.335304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.446372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714deb2-c305-4b7d-8ebe-e6fa5d46c1fa None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:41.502739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:41.503697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.504156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.504649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.505660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=df7219cea0ae464e8df960dd38906b01) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:41.507160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:41.509514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1d946-fce7-47b4-a0a8-35f3573fef8f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:41.512116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba672-e872-4082-b961-0281ec7b2309 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:41.532776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 270/536] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/role_assignments?user.id=df7219cea0ae464e8df960dd38906b01&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:41.534626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e9b6-5d92-4ce4-a06d-157ba2beed79 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.535096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e9b6-5d92-4ce4-a06d-157ba2beed79 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.537972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666e9b6-5d92-4ce4-a06d-157ba2beed79 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.539550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 271/537] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:41.551062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.551629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.552102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.604771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:41.606908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:41.617162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:41.622580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.624667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.624667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.639040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:41.643177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:41.695450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:41.696536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:41.697417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:41.697417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:41.697417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:41.697417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:41.697417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 267/538] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:41.705668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.770464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 272/539] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:41.815935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.841059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298ab6-deb4-4cd2-a64d-0a5a9a746306 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:41.889506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:41.890425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:41.890889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:41.891477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:41.892475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:41.892986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:41.894726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:41.908536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 268/540] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:41.917366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:41.954189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319499-1c0d-4a3b-8996-3db3c2b80c84 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.008300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.008300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.008300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.008300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.040398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:42.045514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:42.046435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:42.047208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:42.058121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 273/541] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:42.068024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:42.078039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa44f7b-52c4-4bbe-bb2d-64a52a03d7fc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.136297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.136297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.136297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.136297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.149228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:42.156299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:42.187276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:42.188181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:42.189514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:42.192994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 269/542] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:42.195346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:42.352184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad312e-37f5-47fb-a3c3-d098f5aa2505 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.380297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548d16d-8868-4774-a355-55eaa453aef6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.427355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.428042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.428560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.428946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.430164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:42.431523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:42.433388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.434058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.434341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.434506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:42.434597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.435389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:42.435692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:42.437183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:42.447451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 274/543] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:42.453588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:42.467783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:42.476294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:42.606166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976c79a-9877-45ef-9e15-2e0204f4a1f8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.650827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.651935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.652229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.652541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.653714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=95bc0f08dd894e9c8edc4c90001f1844) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:42.654038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:42.655677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:42.668859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 271/545] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:42 2022] GET /identity/v3/role_assignments?user.id=95bc0f08dd894e9c8edc4c90001f1844&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:42.779169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8171dc4-96e2-491d-8137-dcdee417d8c8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:42.836838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:42.837700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:42.837989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:42.838269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:42.861378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:42.864293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:42.893034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:42.893962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:42.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:42.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:42.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:42.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:42.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 275/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:42.902268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.016837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6278-7437-4c06-a5de-843f62575071 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:43.051711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:43.052404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.052693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.052974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.053752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:43.054014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:43.055389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:43.069738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 272/547] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:43.077046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.191044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee539-6e96-4694-82ee-7ad91c920606 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:43.230933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:43.231745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.232031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.232338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] PATH_INFO: `/v3/users/swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.240650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:43.242167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:43.257957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:43.258925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:43.260348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 276/548] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:43.272301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.377361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eff80-1992-4aac-975b-5ac0c1bb9e2e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:43.414139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:43.414823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.417976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.417976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.417976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:43.417976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:43.419061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ece5d3-120a-4116-bd1d-474fb5490d67 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:43.439665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 273/549] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:34:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:43.445565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.560264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1dba-925e-4ec7-b298-841904f30f6b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:43.568567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d077a-b006-4652-a7a5-a8a8f6baf0ac None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.568840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d077a-b006-4652-a7a5-a8a8f6baf0ac None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.569092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d077a-b006-4652-a7a5-a8a8f6baf0ac None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.570786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 274/550] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:43.577646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934165f0-29a0-40b8-ad91-c58acd2bae5a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.577938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934165f0-29a0-40b8-ad91-c58acd2bae5a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.584295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934165f0-29a0-40b8-ad91-c58acd2bae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.598633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:43.599396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.599719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-934165f0-29a0-40b8-ad91-c58acd2bae5a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:43.599839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.600011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.600939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-934165f0-29a0-40b8-ad91-c58acd2bae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:43.678052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:43.679916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:43.776966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 275/551] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:43.778801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87d13-4d1a-4b4d-b77d-868400ff0169 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.779290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87d13-4d1a-4b4d-b77d-868400ff0169 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.779762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe87d13-4d1a-4b4d-b77d-868400ff0169 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.785423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 276/552] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:43.789032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.789537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.790012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.802902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 277/553] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:43.810164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.811536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:43.813974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:43.904630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 277/554] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:43.905898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:43.925565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083894bb-6af2-490e-aa0a-fd644ec34ad5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:43.974418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:43.975596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:43.977428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:43.978408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:43.993983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:43.996306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:44.015828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.017038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.018193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:44.018193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:44.018193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.018193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:44.018193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 278/555] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:44.018484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.073839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189764b4-5477-4bd4-b43d-d79bbeb9cb45 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.117754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.118908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.119417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.120462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.131229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:44.139847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.140782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:44.141566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:44.144500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 278/556] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:44.146704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.146827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42d1fc-9aaa-4147-81e0-25f8c9ede8d8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.192906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.193704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.193995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.194274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.215964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:44.224687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.225615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:44.226391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:44.232359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 279/557] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:44.233402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.271857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287dc71-4e03-4c98-838e-7bfe98bdc719 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.316212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.317678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.318176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.318679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.319628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:44.320147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.321763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.344021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 279/558] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:44.345336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.392149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd87c0-6402-419f-a552-658ec53bd908 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.474770 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.476778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.477294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.477774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.478741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:44.479782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.481468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.500743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 280/559] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:44.504414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.562483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d6c8-d073-43da-97aa-94e7449c09d8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.615779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.616471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.616750 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.617020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.617762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:44.618063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.619431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.637825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 280/560] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:44.638633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.679656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1189609-3d90-41d2-b021-e46f3c883765 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.744001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.744892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.745069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.745313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.754032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.755074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731542df-a480-4d1e-b633-4f9c1ef0e9ab None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.755490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7a91f142-84b0-492f-a474-dd7335a40f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:44.770975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.771857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:44.772736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 281/561] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:44.773978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19bbf9-ea93-465b-bbf1-8d3a860b97bc None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.774265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19bbf9-ea93-465b-bbf1-8d3a860b97bc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.774543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19bbf9-ea93-465b-bbf1-8d3a860b97bc None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.780510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 282/562] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:44.780510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19bbf9-ea93-465b-bbf1-8d3a860b97bc None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.803761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.805270 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.805797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.805978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.819205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.820819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:44.837535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.839445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 281/563] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:44.840986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:44.921042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19bbf9-ea93-465b-bbf1-8d3a860b97bc None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.959800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:44.960528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:44.960814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:44.961091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:44.972426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:44.973618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a16a92-990c-4a4e-b8f4-0c52946af455 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:44.974430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-2fa03496-b45b-4afa-88af-b5573eef6442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:44.993186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:44.994088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:44.995677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:44.995677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:44.995677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:44.995677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:45.000409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 283/564] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:45.001766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.002053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.002330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.017272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.019751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.021266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.021536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.023527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.024416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.026107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:45.027290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:45.030221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.047934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 282/565] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.049492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.140661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 284/566] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:45.141578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.154256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc19d-b531-489e-9fdf-ef4819cb7bd1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.189600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.190583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.191095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.191579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.192538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.193045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.194610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.206322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 283/567] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.207513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.253792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42ac94-36d0-4ce2-8bc6-3f3f9f665893 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.287343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.288153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.288372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.288673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.289398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.289700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.291061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.309021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 285/568] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.309934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.313549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e9b09-86ac-4a2f-824e-b6f88758d673 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.351146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.352670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.353273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.353758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.355420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=74292c819dee46f788c7b9af0b9fce7a) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.355957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.357672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.364147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 284/569] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/role_assignments?user.id=74292c819dee46f788c7b9af0b9fce7a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.365319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8bfc0-b060-4059-ac46-c954706c17c3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.464923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.465669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.466258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.466538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.488310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:45.503701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:45.504725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:45.505536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:45.512680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 286/570] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:45.515446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.558207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15793de5-52a0-4670-aea1-fb61a86fcdb8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.632610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.633418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.633709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.633989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.657319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.660081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.668750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b87944-f12a-449e-964b-c75f944dac89 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:45.680850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:45.681830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:45.683302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:45.685792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 285/571] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:45.686763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.721527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.722272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.722559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.722799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.734149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.735644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c6b899a0-25f6-4afe-a566-f39473eaefb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:45.751019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:45.752505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:45.754208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:45.757090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 287/572] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:45.758439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3204e8-1406-420e-8f45-f1035cf3a396 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.758729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3204e8-1406-420e-8f45-f1035cf3a396 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.759009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3204e8-1406-420e-8f45-f1035cf3a396 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.765927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 288/573] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:45.765927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3204e8-1406-420e-8f45-f1035cf3a396 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.872313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3204e8-1406-420e-8f45-f1035cf3a396 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.883356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca857e-5492-4b36-9dd4-7087fd7922c7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:45.906633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.907291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.907596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.907891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.908738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.909066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.910479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.941934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 289/574] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.942819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:45.945477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:45.946345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.946628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.947327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.950469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:45.951330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:45.954688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936654d-af40-484e-8a5c-8793b8dc5082 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:45.966202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 286/575] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:45.967458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:45.967749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:45.968031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:45.986157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:45.987360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:46.085166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 287/576] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:46.086323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.100616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d35499-e53e-4117-9fd9-a89c1dba2e56 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.172386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.173484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.174237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.174726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.175821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:46.176374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.177926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.196461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 290/577] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:34:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:46.202237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.229625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c434b07-a3d2-4995-8d0d-3837cacdc823 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.279678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.282124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.283582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.284451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.308597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4678b-6b78-45d6-a102-efbd03368249 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.314706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.316181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.341133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.341979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.342240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.342500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.352371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.353798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:46.362769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:46.363943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 288/578] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:46.364879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:46.396663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:46.397579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:46.398455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:46.398455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:46.398455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.398455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:46.398455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 291/579] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:46.398748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.496188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dcc5-c781-4865-98de-5efd63d153b6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.509384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacccda-5cf5-4a8a-9bc2-54f86074dc60 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.535576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.536507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.536798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.537079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.545297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.546091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.546374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.546650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.548627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:46.556618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:46.556951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:46.558427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:46.559265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:46.559901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.559971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 289/580] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:46.560502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:46.581833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:46.583842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 292/581] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:46.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.668077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e26d-454d-4199-9f73-5c135d75c546 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.687885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e7f57-45b9-46f7-87c2-8f94b90c2a6a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.703908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.704604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.704893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.705171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.705896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:46.706208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.707574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.724018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 290/582] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:46.724018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.726771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.727436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.727723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.728002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.728905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:46.729266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.730730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.741920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 293/583] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:46.742937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.829063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c41e6a-5b39-49d5-8fd8-ab164252755b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.844266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31d828-aa1a-48b3-acf9-024623b4206b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:46.861420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.862080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.862366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.862648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.863396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:46.863704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.865102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.873706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 291/584] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:46.874780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.880972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:46.881699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:46.881983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:46.882257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:46.883010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:46.883355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:46.884764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:46.900767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 294/585] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:46.902107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:46.975051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e78cc9-37e2-48b2-97f6-0cb148e7cf32 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.003660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfd900-be22-4172-985a-533f61e7986d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.007089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.007878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.008166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.008476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.015210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.016680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:47.031414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.032359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:47.033253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 292/586] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.033745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.039450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.040369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.040658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.040944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.048265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.050108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:47.064998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.065934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:47.066901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 295/587] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.067499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.139897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51516f38-5d4a-47d5-9686-0490d0bf1c70 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.165462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba472b-1e32-4e94-a2c8-92cda7ee6ca7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.173176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.174217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.174503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.174780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.184874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.186543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.202322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.203110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.203395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.203668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:47.204443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.205319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.206209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:47.206209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:47.206209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:47.206209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:47.210126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 293/588] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.210955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.211058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.212516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:47.230544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.231465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:47.232417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:47.236453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 296/589] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.237209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.308679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3538f4-7e7c-4e2f-a4c7-b995d81083db None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.333691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfd0e6-07e5-4de6-b085-7096e9934c24 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.341355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.342019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.342304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.342580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.343440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:47.343756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.345221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.357463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 294/590] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:47.363009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.367366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.368032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.368341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.368621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.369460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:47.370328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.371782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.389176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 297/591] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:47.390036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.488373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252dd65-a9e7-4de8-a63a-882cb7cef984 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.500960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e1db3-3818-4938-943b-3ed064b53fcd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.535101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.535862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.536215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.536590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.537696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:47.538089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.539565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.542924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.543775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.544207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.544672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.545621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:47.545932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.547355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.554460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 295/592] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:47.554620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.567091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 298/593] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:47.568314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.669958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5172895-c67f-458c-a1ca-7d5e8b165438 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.677885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a64c50-13e9-4d24-a294-9ad4abf98765 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.707245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.708522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.708808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.709086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/64b24a8c20fd44f99cd7d961c259ce0a/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.713840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.714639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.714922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.715201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.724385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=64b24a8c20fd44f99cd7d961c259ce0a, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.725842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.726592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.728040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.738945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 296/594] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:47 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/64b24a8c20fd44f99cd7d961c259ce0a/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:47.739762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:47.746840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.747808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.748887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:47.748887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:47.748887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:47.748887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:47.752789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 299/595] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.752789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.865415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871085b6-ef89-4af3-a9d6-77a55ea8ed9e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.869319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e3c66-defa-4a1e-bb13-3c9528faa554 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:47.900051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.901582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.902013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.902324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.906018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:47.906931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.907215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.907491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.910117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.911719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.924338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=7e2c583bb342443e935446db4b26dcd7, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:47.927641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-2f47b626-b608-4e21-bdb5-a926d5165b48 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:47.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:47.928663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:47.929583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:47.930127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 297/596] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:47.933364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8aae-2322-436e-9e5a-b774cce28765 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:47.933364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8aae-2322-436e-9e5a-b774cce28765 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:47.933364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f8aae-2322-436e-9e5a-b774cce28765 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:47.934470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 298/597] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:47.936334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f8aae-2322-436e-9e5a-b774cce28765 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:47.946178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 300/598] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:47 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:47.947072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.058389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567699af-25d9-4e76-bfa8-7cdad7e3cff9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.059417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f8aae-2322-436e-9e5a-b774cce28765 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.095058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.095551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.095739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.096020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.096224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.096360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.096569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.096846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.097157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:48.097462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.097625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:48.097894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.098916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.099355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a8ee5-78ad-4afa-8783-0723c85db24a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.113247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 299/599] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:48.114748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.115042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.115374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.118975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 301/600] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 10 16:34:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:48.120586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.134171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:48.135517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:48.212057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 300/601] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:48.212915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.222035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e57ce-1302-43d3-899f-602079d8dfcd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.257018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.258068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.258350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.258777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.268522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.269970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:48.288199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:48.289329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:48.290397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 302/602] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:48.291003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.339232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c560e-60a6-4f48-a13c-99743414b6f1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.373422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.374915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.375343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.375757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.386724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.388456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.402282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad3c92-c9e3-4268-9c1d-fb81136e9ffc None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:48.407795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:48.408876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:48.409939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:48.409939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:48.409939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:48.409939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:48.411467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 301/603] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:48.412401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.439520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.440660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.440872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.441177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.454251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:48.464397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:48.465504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:48.466521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:48.468074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 303/604] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:48.469052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.517800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341110d-00a6-4504-acd6-112eb1bbd9d6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.554804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.555929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.557711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.558198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.559129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:48.559581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.561165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.580673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 302/605] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:48.580673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.600614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fad1-d7bd-4db3-a8d2-575cf5868d92 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.645160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.646254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.646683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.647583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.648745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:48.649225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.652184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.667037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 304/606] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:48.668155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.682453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a84294-3076-4dd0-9e03-b109cc42fd03 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.716675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.717472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.717831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.718291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.719367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:48.719520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.720975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.730535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 303/607] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:48.731562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.784470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2b1d4-6556-4d8f-b2fd-33cfb82ce024 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.822044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.824498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.824498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.824498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/df7219cea0ae464e8df960dd38906b01/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.840894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=df7219cea0ae464e8df960dd38906b01, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.842964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.862732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c365f8-4263-4e6c-bc9d-b1dfc009ffe1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:48.872388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 305/608] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:48 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/df7219cea0ae464e8df960dd38906b01/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:48.872388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:48.955827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:48.956667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:48.956950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:48.957225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:48.973631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:48.975037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:48.999446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649efd-2f98-4520-bcef-0d214e9cbfd7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:49.009598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:49.010820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:49.011710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 304/609] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:49.016744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.050331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.051143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.051427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.051702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.072482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.074585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:49.094868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:49.097012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:49.099096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:49.099096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:49.099096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:49.099096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:49.099096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 306/610] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:49.104315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.152321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd6408-73bf-4aaa-97d0-d4ddcb87f227 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.190373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.191041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.191328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.191608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.192440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:49.192759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.194209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.206259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d31b7e-3bff-4f19-a6e8-4b21bb721140 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.207630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 305/611] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:49.217233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.249913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.250562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.250844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.251120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.251910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:49.252223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.253674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.267203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 307/612] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:49.275706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.328097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bd96e-daf5-4e7a-a0fc-1f37b183a3c6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.361939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.362804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.363083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.363356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/95bc0f08dd894e9c8edc4c90001f1844/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.377093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e41-57f4-456b-8123-4e644bc8679b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.380593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=95bc0f08dd894e9c8edc4c90001f1844, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.382074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.402193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 306/613] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:49 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/95bc0f08dd894e9c8edc4c90001f1844/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:34:49.441191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.442816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.443315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.443790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.458064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.459983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:49.480613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:49.481760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:49.482720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:49.491440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 308/614] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:49.501557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.659312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b474db-cd75-437d-b0e2-278c2a0bd23f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.696528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.697202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.697482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.698236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.699085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:49.699392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.700863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.719922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 307/615] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:49.725374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:49.839141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336a42b-609f-4911-b2d7-1c25543344ca None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:49.886055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:49.887231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:49.887714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:49.888205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:49.902847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:49.904647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:49.930020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:49.930967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:49.931860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:49.931860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:49.931860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:49.931860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:49.934818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 309/616] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:49.940040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.075841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c5268-5af0-44fb-8771-89c8a50c64e8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.115353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.116029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.116340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.116621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.117360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:50.117672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:50.119057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7c9e-9264-4797-9c00-afe07a652b51 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:50.137002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 308/617] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:50.145339 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14799e-dddc-4bac-a9b9-732a77d0a04f None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14799e-dddc-4bac-a9b9-732a77d0a04f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14799e-dddc-4bac-a9b9-732a77d0a04f None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 309/618] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.208458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.208956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.237665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:50.239368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:50.302669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bc817-8961-4faf-824f-baf6efacb96e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.357635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.358782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.359264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.359737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.367420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:50.369099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:50.371025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 310/619] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:50.394667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:50.399268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:50.400188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:50.401974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:50.404681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 310/620] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:50.410010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.500234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e83f6c-47d9-43e7-abf5-7dfcdf6a77a2 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.546973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.547800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.548088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.548405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.584298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:50.586305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:50.587235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:50.588058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 311/621] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:50.596209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.603151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e324b-9fe6-4f8d-b903-022a175ceb82 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.662553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564efea0-1728-4b95-911e-57395563865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.663139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564efea0-1728-4b95-911e-57395563865d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.663421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564efea0-1728-4b95-911e-57395563865d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.663700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564efea0-1728-4b95-911e-57395563865d None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.664524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564efea0-1728-4b95-911e-57395563865d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:50.664835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564efea0-1728-4b95-911e-57395563865d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:50.666296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564efea0-1728-4b95-911e-57395563865d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:50.680064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 311/622] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:50.686058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564efea0-1728-4b95-911e-57395563865d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.775296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147dd3-e7fa-442d-a3bf-a1fc4c247eb1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.802008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564efea0-1728-4b95-911e-57395563865d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:50.817207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.818572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.819112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.819541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.820633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:50.821349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:50.824633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41afaa84-6175-4623-afa0-30015f37875f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:50.835609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 312/623] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:50.837345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a05a-eb67-4862-aedd-21af42d0e80e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.837639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a05a-eb67-4862-aedd-21af42d0e80e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.837921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a05a-eb67-4862-aedd-21af42d0e80e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.839558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:50.840151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 313/624] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:50.840819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.840934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a05a-eb67-4862-aedd-21af42d0e80e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:50.841389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.841820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/74292c819dee46f788c7b9af0b9fce7a/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.859418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=74292c819dee46f788c7b9af0b9fce7a, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:50.861908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f5c32-8eed-4e56-bdf9-62ed9b510c26 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:50.882536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 312/625] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:34:50 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/74292c819dee46f788c7b9af0b9fce7a/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:34:50.887614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:50.887614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:50.887614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:50.920897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:50.922040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:51.037031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a05a-eb67-4862-aedd-21af42d0e80e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.039144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 313/626] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:51.078766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.079567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.079855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.080128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.085802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.112847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.120536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:51.139112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:51.140078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:51.140971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:51.140971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:51.140971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:51.140971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:51.142996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 314/627] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:51.147392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.211876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5ca10-1ded-4865-9fe2-f17f58b2bc53 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.253590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93b85-2582-4279-a86b-7c98cfa862b9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.258316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.259109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.259389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.259662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.294246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.295270 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.295762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.296242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.297226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:51.297590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:51.298099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.299925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:51.305481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:51.306417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:51.308473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:51.313598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 314/628] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:51.317139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 315/629] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:51.324199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.325017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.437265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d164fe-8b2a-40a7-a9b7-900a5ba7d715 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.477471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.478539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.479241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.480545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.481595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:51.482147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.483798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.496424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 316/630] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:51.507741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.535195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebc4db-e6c0-4b00-af6f-b4013a5ffb7d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.579350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.580439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.581053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.581545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.591676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.598205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:51.624674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:51.626123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 16:34:51.627077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:51.631597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 315/631] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:51.636346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.698663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bced9-5b9d-45d0-8f96-68357f5c284f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.733188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.733907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.734191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.734466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.746318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.747795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.759776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ac2c-069d-4835-bc9a-2441f1ba7ca5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-67d24561-ced5-40ca-9b76-699858099b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:51.766344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:51.767241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:51.768141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:51.768141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:51.768141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:51.768141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:51.768141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 317/632] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:51.772295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d050-827d-4023-bfab-e2a3adb2c38e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.772295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d050-827d-4023-bfab-e2a3adb2c38e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.772295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910d050-827d-4023-bfab-e2a3adb2c38e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.775109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 318/633] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:51.777157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.777367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.777524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.795787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:51.797003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:51.800480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:51.801152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:51.801491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:51.801775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:51.802619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:51.802927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:51.804383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:51.828392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 316/634] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:51.829282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.870584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 319/635] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:51.871533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:51.958668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efeb5a-f78b-4536-a0c2-a1c75ce17df1 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:51.988360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5b017-fd95-45b2-9220-f24cc0f7634e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.005134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.006478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.006974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.007476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.008974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:52.009527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.012193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.024183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.025113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.025226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.025412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.031148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 317/636] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:52.032441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.099233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.100737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.160464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997e8f-3698-4773-be7e-eceb4808970d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.202341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.203212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 320/637] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:52.203731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.204109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.204495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.204979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.216895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:52.224612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.225554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:52.226426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 318/638] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.227133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.303140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8558e8d-1fc4-415a-b012-d71975f6e646 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.324914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef632f-f468-4997-bfd5-3ca81572ea8a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.335737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.336545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.336827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.337097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.344753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.346225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.359168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.359960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.360245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.360667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d01c4cf8-74e1-4b43-bf21-98250348680c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:52.361569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.362463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:52.363403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 321/639] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.364524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba37c-09b6-422d-99c8-d9cc86b8fd64 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.364524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba37c-09b6-422d-99c8-d9cc86b8fd64 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.364524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba37c-09b6-422d-99c8-d9cc86b8fd64 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.365956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 322/640] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:52.371385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba37c-09b6-422d-99c8-d9cc86b8fd64 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.377621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.379075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:52.396612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.397608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.398511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:52.398511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:52.398511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.398511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:52.400426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 319/641] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.401614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.473855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba37c-09b6-422d-99c8-d9cc86b8fd64 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.507679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.508181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.508490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.508771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.509526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:52.509828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.511298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3342-fb78-413b-b65c-04f6444aa6fd None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.515218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b905-0e88-474d-aeb0-1325be618929 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.519308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 323/642] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:52.520620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.520909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.521258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.540173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:52.542539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:52.555330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.555943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.556227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.556536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.558118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:52.558431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.559860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.586608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 320/643] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:52.586608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.610052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 324/644] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:52.610725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.691818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c6190-46c3-4533-9c14-c0cd295ee2cb None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.713602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4eff9-6fc5-4d98-8045-bdbf0d5345e9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.725530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.726190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.726479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.726754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.727472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:52.727779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.729952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.745581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 321/645] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:52.745581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.752439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.753229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.753514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.753782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.764445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.765891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:52.784080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.785191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 325/646] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.786229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.846265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635ec66-44c6-4c1e-8eca-566364d78cb2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.879105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.879757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.880040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.880359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.889511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbec19-e32a-4fd6-9459-ab243399606c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:52.923077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:52.924177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:52.924518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:52.924799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:52.935174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:52.942772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:52.943903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 326/647] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:52.945337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:52.954263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:52.955973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.040487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b065c-018c-4d81-bfa6-71843cf653af None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.053070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 322/648] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:53.054048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.081850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.082611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.082901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.083163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.090515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.091971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:53.106184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:53.107274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:53.108471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 327/649] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:53.109637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.164799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97ea0e-6f9a-4119-9867-19d23321b769 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.200192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.200884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.201164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.201439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.202172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.202461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.203824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.213657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240464a1-241f-4a63-9d2b-17abb7d97136 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.216471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 323/650] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.220456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.250495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.251382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.251845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.252121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.252900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.253208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.254567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.266609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 328/651] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.266609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.318191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3556f1-b1b1-4387-9872-1002f0ca469c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.354668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.355461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.355744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.356024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.366725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.368188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.369555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96881325-5a65-4b29-b3ae-d64033475cb2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:53.386000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:53.387126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:53.388203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:53.388203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:53.388203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:53.388203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:53.388203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 324/652] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:53.388518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.405220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.405892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.406175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.406452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.407238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.407552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.409027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.426110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 329/653] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.426110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.496147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56622f29-9fe8-4f4f-8079-6c4677605e35 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.523426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d599-6db5-486e-a81a-1302c6ea002c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.533538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.534343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.534623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.534896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.543051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.544515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.556535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.557363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.557642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.557917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:53.558314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:53.559374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 325/654] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:53.560425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.570635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.572085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:53.591545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:53.592566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:53.593480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:53.593480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:53.593480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:53.593480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:53.593480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 330/655] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:53.593968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.667646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2deb6-30ce-4cec-9b26-d06a78daebed None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.687225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf024b-37a0-40a9-8523-40e87dd156d7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.699672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.700352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.700640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.700920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.701643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.701953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.703315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6d300-9ec6-4747-8b4f-dd3f1db97b4d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.715527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 326/656] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.716775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500876e-ac1e-4289-bd7b-fba37e3b0b83 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.717063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500876e-ac1e-4289-bd7b-fba37e3b0b83 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.717344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500876e-ac1e-4289-bd7b-fba37e3b0b83 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.718558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 327/657] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:53.720743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500876e-ac1e-4289-bd7b-fba37e3b0b83 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.721709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.722375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.722628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.722900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.723725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=64b24a8c20fd44f99cd7d961c259ce0a) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.724032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.725489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.731997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 331/658] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/role_assignments?user.id=64b24a8c20fd44f99cd7d961c259ce0a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.732795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.831757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500876e-ac1e-4289-bd7b-fba37e3b0b83 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.847132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894cfea-50b4-4e40-b07d-949df4d34df0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:53.870042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.871249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.871722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.871999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.872896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.873205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.874693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.882422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:53.883080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.883363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.883636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.884395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:53.884701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:53.886682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184b143a-7b33-4060-9675-076ada6bc3f7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:53.895611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 328/659] 10.222.0.48 () {56 vars in 1137 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.896965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:53.904163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 332/660] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:53.905757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:53.906212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:53.906633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:53.925430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:53.926562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:53.996651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 333/661] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:53.997724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.008042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f1be-4411-43ac-b773-1a92f7bd2fa5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.041706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.042719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.043004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.043277 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.051069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.052581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:54.067925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:54.069068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:54.070166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:54.074079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 329/662] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:54.074956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.179495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c708a-4d91-4bda-a6a9-94aaeceaf672 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.215097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.215892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.216173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.216476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.219645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f067f-9a61-41b1-9944-44c76d8ccbcf None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.224067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.225537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:54.240294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:54.241268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 330/663] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:54.242190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.256730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.257637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.258101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.258370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.324058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.325537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.337537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe88101-0206-4512-b4e2-eb017e6f2fb0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.370648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.371442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.371727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.372005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.381813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:54.390079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:54.391202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:54.392068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 331/664] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:54.392882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.430679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 334/665] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:54.431645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.487639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852d14d-f8e0-436d-9181-a77e97d7720a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.521904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.522729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.523097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.523381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.524172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:54.524513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.525998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.533494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6996c-536d-4434-97aa-4e44a38287e9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.543776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 332/666] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:54.543776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.565492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.566162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.566444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.566719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.567565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:54.567875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.569419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.593890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 335/667] 10.222.0.48 () {56 vars in 1139 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:54.595078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.643307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f599a6-2648-4c09-aeb0-81ec4d369ecd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.678973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.679637 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.679923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.680192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.681007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:54.681288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.682769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.695070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 333/668] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:54.695223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f767-81ee-40fa-b139-5d325a610b18 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.695341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.731014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.732016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.732869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.733320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.747080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.749321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:54.766954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:54.768091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:54.769163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:54.769163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:54.769163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:54.769163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:54.772657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 336/669] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:54.773483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.794650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac37c91-d54e-4339-b9b2-d538ed927633 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.828079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.828738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.829019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.829294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.830112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:54.830420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:54.831828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:54.848591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 334/670] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:54.848591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:54.904996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b252109-e87f-4986-aeab-279a4ba8e7ce None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.947771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3f12-900e-4343-89b1-f43a87267d66 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:54.948825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.949508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.949847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.950135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:54.986826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:54.988416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:54.988951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:54.989405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.002218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.003838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:55.022464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.023601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.024740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:55.024740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:55.024740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.024740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:55.025021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.025021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.026743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 335/671] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.030010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.131141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1b1a9-9f38-4d02-9089-d6abc9317737 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.135086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 337/672] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:55.135583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.165697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.166212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.167022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.167265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.168349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.168349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.169693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.182412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 336/673] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.183270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.237279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68260fc4-2d90-41db-a600-db8131ea7581 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.270762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.271687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.272116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.272572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.273453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.273906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.275411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.285036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1fcf0-ad27-443b-91d0-ae2f8cf51226 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.292847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 338/674] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.293902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.319658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.320306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.320598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.320962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.331052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.332535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:55.350377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.351476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.352650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:55.352650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:55.352650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:55.352650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:55.352650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 337/675] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.357778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.399430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0043c-c614-45c8-9413-68e76d3c8edd None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.433692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.434730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.435185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.435601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.442786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.444443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.458341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444c5cb-fa8d-4c25-8f86-611e67f80764 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:55.459680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.460732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:55.461783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:55.464677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 339/676] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.465640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.498343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.499110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.499341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.499625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.507654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.509134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:55.524154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.525364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:34:55.526983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:55.530276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 338/677] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.533979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.585699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa06016-66dd-4ff0-8ece-39ca0b089ea5 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.622832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.623778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.624212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.624668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.625535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.626056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.627640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.640294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 340/678] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.641490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.648449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae50077-90c1-4071-8f50-0f91ee45d664 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.684662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.685330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.685616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.685896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.686695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.687005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.688451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.705193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 339/679] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.706074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.747580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86790f7d-cb38-4b43-b143-8357c67b1926 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.788943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.789983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.790475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.790953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.792030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.792586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.794265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.809621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d31c-1603-4076-bc3d-de5fd740f252 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.813747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 341/680] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.814900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.849312 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.851040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.851326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.851602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.858775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.860062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:55.875464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:55.876407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:55.877313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:55.880695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 340/681] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:55.881635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:55.926905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f284e-abe0-4a8e-8697-2fee918c7ddf None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:55.961317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:55.962325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:55.962815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:55.963806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:55.964920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=df7219cea0ae464e8df960dd38906b01) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:55.965449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:55.967119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:55.973641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 342/682] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/role_assignments?user.id=df7219cea0ae464e8df960dd38906b01&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:55.974734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.004511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc3dbb-6907-4ab7-afca-949df16deabf None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.077150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.077739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.078021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.078295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.082294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db37d-c63a-4ae6-900f-ffb2936da6e6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.123078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.124246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.124778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.125350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.126437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.126992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.128899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd1e05-8e1a-46c0-8aaf-ca03be9e8b0e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.144470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 343/683] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:56.146214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364aa4-feed-43a1-9022-765d7167a262 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.146788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364aa4-feed-43a1-9022-765d7167a262 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.147300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364aa4-feed-43a1-9022-765d7167a262 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.149317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 344/684] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:56.150284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364aa4-feed-43a1-9022-765d7167a262 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.176153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.177849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdfc1c-1f60-41f9-9c7c-6797690ba73b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.270573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364aa4-feed-43a1-9022-765d7167a262 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.310936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 341/685] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:56.312048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.312364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.312639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.316095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.317053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.317400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.317681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.318555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=95bc0f08dd894e9c8edc4c90001f1844) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.318869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.323440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.327072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 345/686] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/role_assignments?user.id=95bc0f08dd894e9c8edc4c90001f1844&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:56.327931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.337389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:56.338990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:56.433742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e32d72-b2e3-49cb-83dd-578bb02b8b37 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.469790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.470596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.470879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.471155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.483842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.485355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:56.503942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:56.504928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:56.505811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:56.505811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:56.505811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.505811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:56.505811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 346/687] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:56.511555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 342/688] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:56.520611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.543966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.653365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8148e0b-9ff3-4ff7-8aed-9ff2663adb46 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.655938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf2997-13cf-4f70-89df-ed2b194dfb1d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.689841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.690074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.690508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.690792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.690892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.691089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.691180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.691356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.691788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.692093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.693507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.701940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.703463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.705800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 347/689] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:56.713785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:56.725687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:56.726655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:56.727537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:56.727537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:56.727537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:56.727537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:56.735720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 343/690] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:56.736916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.825118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d351-9a06-4d5d-8719-dc5fc85d7893 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.858127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98223a47-7734-4ff5-b4bd-d3415b96801e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:56.882541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.883771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.884260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.884861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.894657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:56.895320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:56.895607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:56.895888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:56.896653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:56.896943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.901346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.902762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:56.904522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:56.911009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 344/691] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:56.920248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:56.928439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:56.929341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:56.930225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:34:56.933790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 348/692] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:56.939548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.035073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765a4d-d825-4bc4-9124-3e8a3087396d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.081595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.082696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.083182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.083658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.084584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.086240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.105457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b274136-63bc-41d1-95f2-9adc49a7baaa None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.131910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 345/693] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:34:56 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:34:57.152248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.152952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.153233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.153507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.154323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:57.154688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.156109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73b7da-bc0d-4edb-aba1-c3a62142f981 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.175105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 349/694] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:34:57.181377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.339174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b83b9b-bf8e-4960-9351-0aadb6c19f83 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.387692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d446-6af2-4256-bb8d-a09c5c5b19f4 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.388014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d446-6af2-4256-bb8d-a09c5c5b19f4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.388297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487d446-6af2-4256-bb8d-a09c5c5b19f4 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.388930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.389589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.389889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 350/695] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:57.389990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.390197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.391102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=74292c819dee46f788c7b9af0b9fce7a) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:57.391409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.392978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.394928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.395219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.395499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.399533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 346/696] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/role_assignments?user.id=74292c819dee46f788c7b9af0b9fce7a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:57.419732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:57.420913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:57.497665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 351/697] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 16:34:57.519245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.628753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf9db5-6a6a-4c0d-a940-fc8e96acd881 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.662788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.663587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.663961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.664230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.675676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:34:57.683596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:57.684563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:34:57.685412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:57.689718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 347/698] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:57.690936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.792755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4451896-12c4-4440-b4a9-7d276d0e291e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.827861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:57.828558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:57.828842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:57.829116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:57.829860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:57.830164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:57.831526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:57.845331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 352/699] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:57.846676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:57.957383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33cca0-1f5b-4676-92dc-71f1e6fac5ab None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:57.999436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:58.000642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:58.001131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:58.001625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:58.018463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:58.019949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:58.042829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:58.043778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:58.045754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:58.045754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:58.045754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:58.045754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:58.045754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 348/700] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:58.052415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:58.199114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771f522-ba13-4963-a569-5bbe3b39c66e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:58.252963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:58.254029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:58.254568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:58.255052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:58.255995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:58.256531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:58.258111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:58.277672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 353/701] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:58.283490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:58.433077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f011054-55df-4ec2-9859-90fd47018ecc None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:58.481955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:58.482800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:58.483077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:58.483346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:58.496551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:58.498087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:34:58.522760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:58.523755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:58.525561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 349/702] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:34:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:58.533267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:58.702861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8894e2-e1c5-4bbf-b7a2-36a0ffc85c68 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:58.747961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:58.749018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:58.749529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:58.750004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:58.751046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:58.751577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:58.753228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55a667-292e-4ec8-a4f4-73849c3b57ce None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:58.780932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 354/703] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:34:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:58.785923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:58.931458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bee6f-01b8-41d5-9a6a-46c5e2d0cbc8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:58.972150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:58.972807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:58.973094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:58.973365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.059052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.060444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.161476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f455-da6c-4957-b19a-1b2e200215f3 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.161830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f455-da6c-4957-b19a-1b2e200215f3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.162031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f455-da6c-4957-b19a-1b2e200215f3 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.163632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 355/704] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:59.167205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 350/705] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 16:34:59.170813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ab50b-5eb2-4e0b-b021-e9fb8f524d62 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.171104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ab50b-5eb2-4e0b-b021-e9fb8f524d62 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.171512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ab50b-5eb2-4e0b-b021-e9fb8f524d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.172625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.201015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-647ab50b-5eb2-4e0b-b021-e9fb8f524d62 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:59.202282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-647ab50b-5eb2-4e0b-b021-e9fb8f524d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:59.273618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61f02-8649-4a10-a4de-f6d5afb9794a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.309301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.310368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.310845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.311293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.311648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 356/706] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:59.319262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba6b7-a8c6-4e54-be3a-8d9734b835b2 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.319262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba6b7-a8c6-4e54-be3a-8d9734b835b2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.319262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba6b7-a8c6-4e54-be3a-8d9734b835b2 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.319262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 357/707] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:34:59.321596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.321891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.322167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.337387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.339993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.344324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:34:59.344324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:34:59.364600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:59.365615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:59.366700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:34:59.366700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:34:59.366700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:34:59.366700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.366700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 351/708] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:34:59.367785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.428296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 358/709] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:34:59.428296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.490404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45dff4c-cddc-4f03-899c-f77a892402c9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.519683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991afb6c-237c-4ccb-aeb7-8eb523ba611d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.524972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.526816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.527254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.527676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] PATH_INFO: `/v3/services/network` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.528554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.530135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:59.544257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:59.545479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:34:59.546343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.549431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 352/710] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:59.550386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.568013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.568637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.568916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.569189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.569925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:59.570212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.571575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.587862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 359/711] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:59.588732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.672299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78868c3-af2f-47a6-996e-4a332348683d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.690290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f00c0b-e483-48e6-89ca-0c3be370ed1c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.702900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.704072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.704623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.705077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.705888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.707592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.722724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:59.723341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:59.724227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:34:59.725122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.726409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.729108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 353/712] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:59.729383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.737743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 360/713] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:59.738614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.845391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68db28d-ea91-47eb-9235-572921a1db77 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.858496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19876e0-f001-4c3e-a95a-ed03a1a967d9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:34:59.879219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.880014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.882183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.882484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.890585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.892040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.896967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:34:59.897676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:34:59.897961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:34:59.898393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:34:59.899214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:34:59.899522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:34:59.901686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:34:59.907475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:34:59.909429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:34:59.912005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 354/715] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:34:59.913460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 361/715] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:34:59.913615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:34:59.913757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.011661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f693673-3cc6-4387-ba93-d7d2c638d8de None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.019698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9eff-21e9-41ee-bb7c-e1567ddd094b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.047223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.047883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.048163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.048463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.049427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] RBAC: Adding query filter params (type=network) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.049730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.051089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.054332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de977-3631-4687-bc16-f824938843e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.055186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de977-3631-4687-bc16-f824938843e6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.055649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de977-3631-4687-bc16-f824938843e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.056126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de977-3631-4687-bc16-f824938843e6 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.060326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 355/716] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.060326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.065239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de977-3631-4687-bc16-f824938843e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.065895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de977-3631-4687-bc16-f824938843e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.068309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de977-3631-4687-bc16-f824938843e6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.078202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 362/717] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:34:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.080092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9510e-1d0f-4550-ba8b-ff9c2aa1a9b3 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.080656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9510e-1d0f-4550-ba8b-ff9c2aa1a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.081143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9510e-1d0f-4550-ba8b-ff9c2aa1a9b3 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.088884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 363/718] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:00.090673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.091174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.092346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.113299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:00.115193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:00.208453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 364/719] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:35:00.235929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.291844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68fd6-7a0c-422a-96f3-43a387ecd1ff None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.335843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.336964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.337468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.338170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.339359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.339872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.342034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.355463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 356/720] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.360811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.373262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f21a04-9e11-42de-b6b9-ae8b57b5382a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.416655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.417460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.417737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.418011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.429175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-704a9f62-6e19-4e32-9668-621ff414da61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:00.439141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:00.440355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:00.441265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:00.445696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 365/721] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:00.445696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be60ac-b9af-44fd-bd78-98e0aa07a5a5 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.445696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be60ac-b9af-44fd-bd78-98e0aa07a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.445696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be60ac-b9af-44fd-bd78-98e0aa07a5a5 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.445696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 366/722] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:00.455172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.455595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.456009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.472554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:00.473853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:00.480636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fac59-3f14-4c20-8d30-c5795550a971 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.524071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.525786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.526453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.527105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.528434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.528913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.530515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.542709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 357/723] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.543850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.562454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 367/724] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:35:00.603355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.662154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c383-5496-424b-b704-b250b48ad87f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.702605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.703535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.703967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.704422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.705320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:00.706217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.707828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.718953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 358/725] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:00.729586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.811897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03dc9-ef13-486b-bc46-a6cd2b1092bd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.852243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.853076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.853351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.854176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.864857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:00.870531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8413b50-9d37-432b-ab46-ec6da090ad4d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:00.874232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:00.875969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:00.878600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:00.888300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 368/726] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:00.888300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.906669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:00.907465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:00.907742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:00.908014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:00.935197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:00.936614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:00.965205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:00.967423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:00.969635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:00.969635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:00.969635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:00.969635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:00.969635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 359/727] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:00.977487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:00.988649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61a7e-e9f8-4fb1-928e-290f4dfe3f2d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.022067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.022728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.023007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.023279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.024021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.024349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.026282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.034870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 369/728] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:01.040164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.138734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682648b-113c-4eb0-95b2-3cc9df23461f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.162794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4aaea4-145c-4bee-bda3-3362634b5c94 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.172214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.173033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.173312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.173590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.185083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.186600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:01.204024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:01.206562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:01.208795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:01.208795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:01.208795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:01.208795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:01.208795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 370/729] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:01.214756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.236638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.238690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.238690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.238690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.239263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.239263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.240523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.255416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 360/730] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:01.260925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.364523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a327b05-dca7-4614-a008-9b893a73d4de None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.407086 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.409321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.410449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.410936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.421702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.424752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.428471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b1c1e-2d75-40a4-be16-7579e46d4adb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:01.453452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:01.454450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:01.455471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:01.465070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 361/731] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:01.477322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.492298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.492298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.492298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.492298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.492703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.492703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.492703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.504252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 371/732] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:01.510424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.644530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023a31-c8f7-4f28-87d2-8cc62cc6e568 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.678960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.680137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.680680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.681202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.688875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.690621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:01.705738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:01.706683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:01.707620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:01.710646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 372/733] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:01.714476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f405e1-570e-48fb-9c86-cc811435296d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.716229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.802343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.803024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.803332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.803593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.804502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.804745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.806185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.817475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca541-1355-469b-984a-51c6b708d0ce None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:01.843886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 362/734] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:01.848938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:01.857975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:01.859206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:01.859746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:01.860231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:01.861330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:01.861846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:01.863486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:01.882155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 373/735] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:01.890913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.027818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca3350-8ca9-4a11-a523-0e2c3819f52e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.077526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.078180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.078463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.078743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.086377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f90b30-245b-4950-9823-ff58663fcfb9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.146577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.148038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.169001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.169671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.169962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.170246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.247682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 363/736] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:35:02.253081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.289827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.292288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.352528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845663a-6bf1-49ff-8b62-b86936aa41d1 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.386631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.387428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.387710 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.387991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.395239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 374/737] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 16:35:02.398294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.399830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.401156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:02.418064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:02.419011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:02.421008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:02.421008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:02.421008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:02.421008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:02.421008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 364/738] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:02.425094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.501602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326adcd1-c5f4-4daf-972a-6e15a3a7a7b2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.528163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca536da-8078-4652-857e-8fa99568fb34 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.544594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.545322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.545608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.545887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.556285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.558653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:02.580214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:02.581116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:02.582888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:02.582888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:02.582888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:02.582888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:02.582888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 375/739] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:02.587093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.601847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.602539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.602827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.603107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.604202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:02.604556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.605975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.636715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 365/740] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:02.637713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.699965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b33390-4f4d-466a-8e75-523fab4358cf None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.736265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.737212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.737648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.738076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.739048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:02.739512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.741054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.753839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 376/741] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:02.759373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.811171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8867728-d8ed-4d90-a97a-b820d547064e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.848399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.849442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.849874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.850291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.857810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.859422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.870351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043c242-a1e7-45d5-85af-57cbde171771 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-138a265b-fc1f-4f2a-b9b1-a75f029ef424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:02.874047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:02.874935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:02.875844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 366/742] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:02.881200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d56d-6f26-4ba6-b759-76196f510430 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.881200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d56d-6f26-4ba6-b759-76196f510430 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.881518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294d56d-6f26-4ba6-b759-76196f510430 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.882913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 367/743] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:02.883837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e64ae-36ee-474c-b242-bb182f0fd114 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.885340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e64ae-36ee-474c-b242-bb182f0fd114 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.885748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e64ae-36ee-474c-b242-bb182f0fd114 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.887216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 368/744] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:02.887788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e64ae-36ee-474c-b242-bb182f0fd114 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:02.911857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:02.912679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.912959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.913230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.920696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:02.922155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4edda537-85fc-46d1-a5bb-d5bb59f7a8eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:02.936407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:02.937320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:02.938210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 377/745] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:02.939239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc36da-b57f-4293-8313-b008a0f7017c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:02.939239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc36da-b57f-4293-8313-b008a0f7017c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:02.939383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc36da-b57f-4293-8313-b008a0f7017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:02.956017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-dccc36da-b57f-4293-8313-b008a0f7017c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:02.957216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-dccc36da-b57f-4293-8313-b008a0f7017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:02.991528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e64ae-36ee-474c-b242-bb182f0fd114 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.022646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 378/746] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:35:03.023931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.024216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.024518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.033618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.034510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.034987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.035270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.036065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:03.036412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.037844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.047951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:03.049802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:03.054606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 369/747] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:03.055478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.113511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 379/748] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 16:35:03.114332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.154475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5897b-9508-42e3-b2ef-0b8385ccfe06 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.191455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.192119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.192440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.192714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.193529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:03.193844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.195252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.226195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8668f-1c25-436a-a7a2-143910ba808b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.261764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.262449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.262729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.263001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.263734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.265176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.284581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 380/749] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:03 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:03.285233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.339206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 370/750] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:03.340785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.419513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b065f-c8e5-407d-aa64-5a4aafb6f77d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.456469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152405ac-eac3-4040-9f04-e60fca2f82d9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.457505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.458290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.458801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.459082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.460669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=3f5322815d884ee89bf30f2b0fd84287) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:03.460669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.462008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.472655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 381/751] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:03 2022] GET /identity/v3/role_assignments?user.id=3f5322815d884ee89bf30f2b0fd84287&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:03.472655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.503482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.504171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.504493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.505059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.505607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.507306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f173a-ded1-446e-99f8-27d01858abf1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.528351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 371/752] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:03 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:03.529661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed938-49c3-4d45-81f3-4da2175326ab None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.529941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed938-49c3-4d45-81f3-4da2175326ab None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.530213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ed938-49c3-4d45-81f3-4da2175326ab None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.533627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 372/753] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:03.538284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.538879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.539299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.564311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:03.564311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:03.620360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211a83-d522-4b38-bfdc-463fb3e973da None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.668316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 373/754] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:03.675621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.676672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.677230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.677718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.678779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=74292c819dee46f788c7b9af0b9fce7a) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:03.679305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:03.681036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:03.689103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 382/755] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:03 2022] GET /identity/v3/role_assignments?user.id=74292c819dee46f788c7b9af0b9fce7a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:03.693777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.809608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446c7e6-9932-4e41-a6f1-81f763df6fd5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:03.848748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:03.849561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:03.849842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:03.850115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:03.862348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:03.870947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:03.872097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:03.873005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:03.876672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 374/756] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:03.878513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:03.999122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa633e-da86-4e2f-8968-7201b4b0727f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.037800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.038477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.038759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.039033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.039780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:04.040083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.042034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.056250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 383/757] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:04.062473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.180878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64e27f-19bd-45ba-8578-c73432c3dfcc None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.221623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.222418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.222697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.222966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.235000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.236476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:04.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:04.255062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:04.256656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:04.256656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:04.256656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:04.256656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:04.256656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 375/758] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:04.260952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.384398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f662031-c7f7-426d-9df2-6eac5d911d9a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.433078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.433740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.434019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.434289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.435015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:04.435315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.436714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.454133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 384/759] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:04.459244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.591583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698567c-7470-4114-a46f-d6578a65a934 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.636962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.637755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.638041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.638320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.645844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.647255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:04.666362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:04.667349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:04.668920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 376/760] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:04.673264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.774599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9a598-6792-4209-9033-23931e9a4476 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:04.819328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:04.820057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:04.820363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:04.820652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:04.821480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:04.821786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:04.823339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:04.841363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 385/761] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:04.849338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:04.973043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094bb5b-e187-4d58-9781-06a2c07d5041 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.014240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.015026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.015304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.015578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.033264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.034705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:05.057939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:05.058868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:05.060482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:05.060482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:05.060482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:05.060482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:05.060482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 377/762] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:05.064646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.183216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3041e-88f7-49bb-97db-b68f47ccd896 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.225782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.226445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.226728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.227000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.227716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:05.228017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.229940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.248548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 386/763] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:05.253508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.380676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c9643-789f-4116-b8af-839f1be537ec None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.413117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.413915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.414219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.414493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.422420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.424114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:05.438995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:05.439977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:05.441372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 378/764] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:05.449421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.561894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2c1c-0621-40e8-8d3b-7120801c917b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.609111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.609819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.610106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.610381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.611168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:05.611472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.612925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3a5f9-4f28-4b25-bf5f-4f98940cf0d1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.630816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 387/765] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:05.636931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:05.778710 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab2d4-841e-4486-8492-446a7340725f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:05.819769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:05.820693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:05.820974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:05.821256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:05.829057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=7e2c583bb342443e935446db4b26dcd7, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:05.830519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3bf5-6185-44ee-b658-74d8ba51ed19 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:05.856112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 379/766] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:05 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:06.107780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcaa5-8b06-47bd-a700-9dbc9ffe9f51 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.108314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcaa5-8b06-47bd-a700-9dbc9ffe9f51 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.108397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adcaa5-8b06-47bd-a700-9dbc9ffe9f51 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.109898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 388/767] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:06.126184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.126492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.126753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.145404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:06.146619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:06.191624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fd92-4fcf-413b-92c1-389baaa912b1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.191943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fd92-4fcf-413b-92c1-389baaa912b1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.192175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9fd92-4fcf-413b-92c1-389baaa912b1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.193608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 389/768] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:06.205993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.206301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.206530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.231863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 380/769] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:06.235639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:06.236890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:06.266792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.320783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 390/770] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:06.343752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.385586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282014-90a6-48b2-8f3f-9c21ca993284 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.420756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.421542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.421820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.422090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] PATH_INFO: `/v3/services/network` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.422732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.424359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:06.438322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:06.439363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:06.440243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:06.441249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 381/771] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:06.449591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.476649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee6bf5-aece-465c-b310-c4393fcbe79b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.547817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.548661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.549197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.549471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.585437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-eb55743c-d5d6-4982-b56c-b48e991610a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:06.594078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:06.595046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:06.595869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 391/772] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:06.601764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12cbf-d0a9-47d6-b121-c0b6b4e31521 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.602130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12cbf-d0a9-47d6-b121-c0b6b4e31521 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.602401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab12cbf-d0a9-47d6-b121-c0b6b4e31521 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.604194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 392/773] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:06.604773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12cbf-d0a9-47d6-b121-c0b6b4e31521 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.625829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9448c-3b03-4eb1-9f61-e2272783d85b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.660550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.661290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.661668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.662033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.662829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:06.663228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.664709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e58d86-a6b1-4ba5-8db3-8f26dd678cb6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.670119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 382/774] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:06.671215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.671599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.671967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.689220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:06.690518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:06.730649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab12cbf-d0a9-47d6-b121-c0b6b4e31521 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.759052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 383/775] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:06.760810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.781031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.781722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.782011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.782292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.783060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:06.783372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.784791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.794155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 393/776] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:06.794941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.869526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74148-abb8-4bf6-b980-aa6195204582 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.903884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817aa41-1e46-43eb-b21c-524e8cc46218 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:06.908912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.909760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.910221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.910697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.912055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] RBAC: Adding query filter params (type=network) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:06.912900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.915667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.924614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 384/777] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:06.925747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:06.944996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:06.945811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:06.946103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:06.946382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:06.947576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:06.949658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:06.965217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:06.966415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:06.967657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 394/778] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:06.968605 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.034233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431722d-cda1-47f1-80d8-fd72ceeeddae None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.071423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.071672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0bc70-8f18-4523-b881-4f82c6935144 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.073301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.073729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.074310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.086168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.087699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.104814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.105468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.105747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.106020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.106810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] RBAC: Adding query filter params (interface=public, service_id=9cc7fea64965444a9c8e29e430fca421, region_id=RegionOne) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.107122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:07.107227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:07.108066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 385/779] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:07.109938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.112813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a614-e5b9-4ede-9425-6b1510fc4fe6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.127393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 395/780] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:06 2022] GET /identity/v3/endpoints?service_id=9cc7fea64965444a9c8e29e430fca421&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.127393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101a7-50de-4b23-ac75-3605bb86173a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.127393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101a7-50de-4b23-ac75-3605bb86173a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.127393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101a7-50de-4b23-ac75-3605bb86173a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.128993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 396/781] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:07.131771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a101a7-50de-4b23-ac75-3605bb86173a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.211587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc940da-b486-4ead-80e2-0871cca59839 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.229126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a101a7-50de-4b23-ac75-3605bb86173a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.244631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.245523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.245811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.246085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.246786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.247101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.248473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.252828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 386/782] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.253595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.268075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.268756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.269042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.269310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.270029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.270332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.271709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aeee8-e772-4810-aba0-54c6e011adf8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.282688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 397/783] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.283800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.284089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.284385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.300711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:07.301875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:07.362961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e525b-c136-49e1-85db-b20aae46dafd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.367159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 398/784] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:07.367874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.409755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.410418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.410708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.410984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.411693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.413088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.419584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 387/785] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.420351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.501476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3130eea-84dd-427d-8dd5-bb3c8694de60 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.547233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff02960-8dd6-4d24-b28d-e12ef9d1fa9b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.552114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.552849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.553135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.553413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.554145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.554456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.555869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.563490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 399/786] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.564554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.595289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.596291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.596606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.596887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.608550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.610034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:07.631142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:07.632516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 388/787] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:07.633460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.691288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c5a36-2413-4ce9-aa04-01c7557b161c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.734902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.735969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.736262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.736563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.749852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:07.754541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ed2b-5ba9-45dd-b5fc-42af4570d898 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:07.759213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:07.760871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:07.761732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:07.766754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 400/788] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:07.767611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.797765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.799560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.800210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.800762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.801898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] RBAC: Adding query filter params (interface=public, service_id=c98196e91ab84ab4a26dac44788ce3d7, region_id=RegionOne) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.802700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.804768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.815550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 389/789] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/endpoints?service_id=c98196e91ab84ab4a26dac44788ce3d7&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.816794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.891785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420d3e-8e13-4066-ad60-61c73497aad1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.928177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.929235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.929701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.930156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.931176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.932051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66943-3033-43bb-a7b3-1838cd6d33b4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:07.932440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.934082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.955283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 401/790] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.956534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:07.968598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:07.969364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:07.969721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:07.970290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:07.970905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:07.971281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:07.972768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:07.983632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 390/791] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:07.984516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.081832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b7a57-8274-4071-9e30-25488c1e9b92 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.094294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50956f-0cf3-473c-857c-4c697f8c6bef None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.126226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696db17-906a-429d-9955-25914ed2415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.127499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696db17-906a-429d-9955-25914ed2415f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.127934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696db17-906a-429d-9955-25914ed2415f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.128412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696db17-906a-429d-9955-25914ed2415f None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.129232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696db17-906a-429d-9955-25914ed2415f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.129803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.130688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.131068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.131240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696db17-906a-429d-9955-25914ed2415f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.131539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.138246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 402/792] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:08.139281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696db17-906a-429d-9955-25914ed2415f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.152128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.156922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:08.199281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:08.200459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:08.201445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:08.201445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:08.201445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:08.201445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:08.206058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 391/793] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:08.210017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.366816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696db17-906a-429d-9955-25914ed2415f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.393672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f84da7-79b1-4ca6-8d28-4264298d1417 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.409853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.410845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.411160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.411558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.423963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.425597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.436795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.437995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.438425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.438869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.439744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:08.440195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.441804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:08.446577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:08.448091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:08.449320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:08.449320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:08.449320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:08.449320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:08.455784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 403/794] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:08.456798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.457853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 392/795] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:08.463417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.572471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343806-1386-430a-bafb-c8d5f7a651dc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.585357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3495-c73b-48bc-aed3-2eb0badbe366 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.623128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.624048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.624317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.624773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.625172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.625338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.625627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.625993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.626528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:08.627125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.629208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c24a-9e7f-4cc2-a93e-c26f71a78696 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.633303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.634893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.643234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 404/796] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:08.644824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ed36-be90-4683-bb2f-ab34cf5c3466 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.645315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ed36-be90-4683-bb2f-ab34cf5c3466 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.645755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ed36-be90-4683-bb2f-ab34cf5c3466 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.647429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 405/797] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:08.655125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.655125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.655125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:08.655436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:08.656460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:08.657613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:08.658760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 393/798] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:08.659701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.680437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:08.681688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:08.753405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 406/799] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:08.754336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.760499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf587b4-d828-4334-9537-6df30ca573e4 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.794932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.795728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.796014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.796305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.804032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.805504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:08.820663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:08.821646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:08.822753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 394/800] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:08.824653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.853814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295dae7-9bc9-47e4-b907-057305de2b39 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.893683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.894268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.894556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.894834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.895633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:08.895943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:08.897416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:08.914288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 407/801] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:08.915198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:08.924780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009441c-07b5-4391-9a61-7b5063a64a42 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:08.958874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:08.959660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:08.959943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:08.960221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:08.970513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:08.978602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:08.980840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 395/802] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:08.982992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.014918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249497-03f2-4031-986e-c5c36e45cb85 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.048447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.049370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.049654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.049929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.050773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.051082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.052539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.070431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 408/803] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:35:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:09.071330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.079060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f241542-c0ad-4d1c-a71d-87fa998964cd None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.112459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.113352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.113633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.113908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/3f5322815d884ee89bf30f2b0fd84287/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.128946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=3f5322815d884ee89bf30f2b0fd84287, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.130394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.146572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 396/804] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:08 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/3f5322815d884ee89bf30f2b0fd84287/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:09.147256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.198674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfc24a-06ed-4c54-8d6a-5a809f45b5b6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.284937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.285624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.285964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.286245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.287013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.287315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.288740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.310875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 409/805] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:09.316240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4237e-830d-409c-9b88-68d03850f351 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.318874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.390066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.391271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.391759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.392244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.403152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.404940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:09.423036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.424234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.425151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:09.425151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:09.425151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.425151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:09.428218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 397/806] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:09.432264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e0724-eac7-439e-86b0-69a761aef365 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.434957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.476842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.478756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.479313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.479793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.502260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.503729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:09.536541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.537521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.538492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:09.538492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:09.538492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:09.538492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:09.548304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 410/807] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:09.553359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.583329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b35c3-ff9d-475e-9998-4980da397ef6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.652392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.653067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.653405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.653622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.654355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.654663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.656028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.679713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 398/808] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:09.686677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.741529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cda3d-b5a1-433d-884c-26b67d85f274 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.810297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.811800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.812810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.813627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.814571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:09.818195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.819816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.837598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 411/809] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:09.846809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:09.873296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2115ab7-0519-42bf-b951-80a06c9368e7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:09.939693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:09.940438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.940724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.941003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.954193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:09.955664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-5b14cca8-0f25-4761-bc2d-a2bb8fddf262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:09.976209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:09.977196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:09.978595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 399/810] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:09.980626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bdf-e1ae-4f6b-9f30-2e737a803280 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:09.980626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bdf-e1ae-4f6b-9f30-2e737a803280 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:09.980626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365bdf-e1ae-4f6b-9f30-2e737a803280 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:09.985391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 400/811] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:09.986590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365bdf-e1ae-4f6b-9f30-2e737a803280 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.002252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c561ba5-1993-4f50-b8f4-500eb086ae50 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.037456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.038250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.038537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.038813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.047372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.049118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-647d3004-544a-467b-9fec-67eca16016bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:10.064198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:10.065885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 412/812] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.067237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.068095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.083972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:10.085185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:10.090889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365bdf-e1ae-4f6b-9f30-2e737a803280 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.132731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.133523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.133815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.134097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.135727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:10.136047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.137829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.159279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 401/813] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:10.160490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.168564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 413/814] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:10.170365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.288902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5924d8-1168-4912-90bc-497a6c21a4d5 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.292024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c449-b4ea-45cb-ae42-f778d9c8e59e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.325458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.326251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.326603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.326947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.327848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:10.328224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.329734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.329870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.330649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.330940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.331220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/74292c819dee46f788c7b9af0b9fce7a/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.334207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=74292c819dee46f788c7b9af0b9fce7a, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.335652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.351193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 402/815] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:10.352015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.359386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 414/816] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:10 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/74292c819dee46f788c7b9af0b9fce7a/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:10.360206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.509208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b6a-9efa-4d1f-bd96-7daf6167c236 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.550964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.551544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.551832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.552112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.625901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1af5c5-4367-453a-a93b-e90de40a8b09 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.637703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.639955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.663986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.664827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.665110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.665389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] PATH_INFO: `/v3/services/network` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.666927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.668302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:10.685233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:10.686258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:10.687156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 403/817] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/services/network => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:10.692255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.761124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 415/818] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:10.781790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.807167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71773fa0-d3db-4ae4-8514-31c491ceba55 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.845540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.846376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.846986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.847410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.848259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] RBAC: Adding query filter params (name=network) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:10.848605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:10.850941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d8d-11bc-48db-b7e4-e7aa7b1db975 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:10.856668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 404/819] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:10.858437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a1da-65f0-44be-a89a-0bc47ea2aa89 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.859100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a1da-65f0-44be-a89a-0bc47ea2aa89 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.859387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38a1da-65f0-44be-a89a-0bc47ea2aa89 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.861861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 405/820] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:10.862574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38a1da-65f0-44be-a89a-0bc47ea2aa89 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:10.939094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11e5f8-8052-4717-b7cd-a589bf297179 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.968250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38a1da-65f0-44be-a89a-0bc47ea2aa89 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:10.983274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:10.984509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:10.984800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:10.985082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:10.998412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.000378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.004989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558032f-ef31-46b5-921b-29144294383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.005873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558032f-ef31-46b5-921b-29144294383a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.006304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558032f-ef31-46b5-921b-29144294383a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.006728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558032f-ef31-46b5-921b-29144294383a None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.007630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558032f-ef31-46b5-921b-29144294383a None admin] RBAC: Adding query filter params (type=network) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.008087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558032f-ef31-46b5-921b-29144294383a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.009737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558032f-ef31-46b5-921b-29144294383a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.015288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 406/821] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:11.016818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.017276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.017749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:11.019050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:11.020136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:11.021145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:11.021145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:11.021145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:11.021145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:11.025564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 416/822] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:11.027722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.039152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:11.040594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:11.128360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 407/823] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:11.129654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.142101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c2fd3-2954-497c-a6c4-61d9651230a8 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.184948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.185653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.185941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.186217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.187455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.188881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.217149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 417/824] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:11.219131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.268971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ba66e-875b-41c9-be2c-6e8d5c76493b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.325909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.327131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.327432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.327711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.328843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.329158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.330608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.331619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d0f65-9a35-4540-94ed-658a6a464f93 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.346901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 408/825] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:11.352837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.372030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.373295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.373827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.374317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.375230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.376902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:11.390998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:11.391984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 16:35:11.392889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:11.400718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 418/826] 10.222.0.48 () {56 vars in 1129 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:11.404756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.480929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7a8f-f779-4a45-9ef4-3ca698082ad3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.515929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa7ea9-7236-4944-b64c-804e0e965192 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.517108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615cad-b43b-4617-922d-451f41020344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.518372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615cad-b43b-4617-922d-451f41020344 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.518492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615cad-b43b-4617-922d-451f41020344 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.518772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615cad-b43b-4617-922d-451f41020344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.526922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19615cad-b43b-4617-922d-451f41020344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.528445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19615cad-b43b-4617-922d-451f41020344 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-19615cad-b43b-4617-922d-451f41020344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:11.544503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:11.545508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:11.547498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 409/827] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:11.552234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615cad-b43b-4617-922d-451f41020344 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.573583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.574264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.574553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.574829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.575552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.575858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.581381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.591438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 419/828] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:11.597860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.663294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615cad-b43b-4617-922d-451f41020344 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.705781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.706828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.707328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.707820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.708846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.709386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.711044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea08e4-00f8-4a25-acee-ae3cc17a3dba None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.715875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ab2e2-9d60-4662-b9b9-17565b7dbeba None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.724597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 410/829] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:11.726220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a7987-d18c-4fa1-9d53-a04e945eb150 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.726727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a7987-d18c-4fa1-9d53-a04e945eb150 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.727237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a7987-d18c-4fa1-9d53-a04e945eb150 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.733827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 411/830] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:11.733827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a7987-d18c-4fa1-9d53-a04e945eb150 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.754416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.755080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.755421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.756111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.756899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.757500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.759396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d556dd3-9628-478e-a171-991bf0673f21 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.770422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 420/831] 10.222.0.48 () {56 vars in 1124 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:11.770422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514e9-23d3-47a3-965f-437c160d282b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.770422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514e9-23d3-47a3-965f-437c160d282b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.770422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188514e9-23d3-47a3-965f-437c160d282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.785891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-188514e9-23d3-47a3-965f-437c160d282b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:11.787059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-188514e9-23d3-47a3-965f-437c160d282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:11.838721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a7987-d18c-4fa1-9d53-a04e945eb150 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:11.860300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 421/832] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:11.860300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188514e9-23d3-47a3-965f-437c160d282b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.881743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:11.882485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:11.882858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:11.883144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:11.883975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:11.884857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:11.886343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:11.892336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 412/833] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:11.893120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:11.965837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188514e9-23d3-47a3-965f-437c160d282b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.008023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.008975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.009776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.010064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.011246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.012981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.017712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d606-e756-40bf-b818-884ae63a4352 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.039399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 422/834] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:12.069656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.070823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.071297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.071825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.085477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:12.094190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:12.095425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:35:12.096491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:12.098805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 413/835] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:12.107915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:12.215027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83d5b0-20bf-43cc-b660-e79f601826d3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.252862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.253458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.253741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.254015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.254760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:12.255067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.256499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.265529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 423/836] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:12.270998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:12.377288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce91c-4119-4f8c-817b-54b63c28a37f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.411993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.412813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.413096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.413446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.424755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.426205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:12.444091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:12.445058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:12.446159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:12.446159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:12.446159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:12.446159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:12.446159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 414/837] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:12.452994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:12.555595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4332cd2-5f37-44c7-9f5c-346450a201ad None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.595438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.595438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.595438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.595438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.595868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:12.595868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.595868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.612483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 424/838] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:12.614517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:12.725761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daa223-2519-4e57-9b0f-8ae41f800440 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.761167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.761977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.762261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.762534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.770038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.771475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:12.786266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:12.787271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:12.788441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 415/839] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:12.797310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:12.904724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e1828-d888-482c-9262-95dbd5640230 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:12.941760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:12.942431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:12.942720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:12.942998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:12.943834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:12.944144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:12.945604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d086eb-4525-4be4-9fb0-10fa73f3ba6e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:12.964328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 425/840] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:12.970010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.071566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27564e30-e89d-4bfe-8c77-a8337c64d700 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.097559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5bae8-9bc6-4015-a0d7-14e83fb7ad66 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.097864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5bae8-9bc6-4015-a0d7-14e83fb7ad66 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.098128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5bae8-9bc6-4015-a0d7-14e83fb7ad66 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.099792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 426/841] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:13.104714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.105004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.105279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.109363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.110270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.110765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.111266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.122181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:13.123350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:13.199609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.200616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 427/842] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:13.201781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.217372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.319865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016bbb0-ccd4-41bf-b795-2a97970cf6cc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.327008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 416/843] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:13.328616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.356341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.356866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.357152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.357431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.367978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:13.375898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:13.376891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:13.378816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 428/844] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:13.383068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.442271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845d0e1-e636-4f81-80a5-a325ec8fafe7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.479213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.480370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.480870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.481388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.482565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3405-6b0e-46b7-a271-b3afe43b0add None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.492389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.494744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:13.514267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:13.515404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:13.516533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:13.516533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:13.516533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:13.516533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:13.518282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.519853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.519853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.519853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.520492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 417/845] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:13.523891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:13.524595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.525855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.527765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.538038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 429/846] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:13.544823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.637828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf30d95-5230-4ef0-acb8-33bfb3a96683 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.668815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783abbef-6729-4b6e-a95c-0b80472c3b04 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.678847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.679515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.679798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.680072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.680843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:13.682072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.683588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.700422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 418/847] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:13.701814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.711360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.712523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.713026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.713879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.727234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.730011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:13.752424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:13.753370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:13.754278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:13.754278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:13.754278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:13.754278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:13.761434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 430/848] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:13.762261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.827111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50208674-0dfd-4d2b-9b78-5751ebb3211e None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.860112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c094d4-fcda-4ae4-8b12-6aa91531503b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:13.872717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.874031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.874926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.875688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.885622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.887971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.895452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:13.896243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:13.896625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:13.897036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:13.897815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:13.898186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:13.899665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:13.907309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:13.908209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:13.909243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:13.911890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 419/849] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:13.919840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:13.920257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 431/850] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:13.921160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.036728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27fee0-ccf4-447f-a48c-7f78a7a00430 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.040074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab5964-3873-4fba-8afe-ef14a78f8c10 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.071386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.074004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.074492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.074992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.081341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.081997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.082281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.082558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.083654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.083971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.084591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.085438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.086479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.100317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 420/851] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.105563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:14.107030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.107998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 16:35:14.108973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:14.113005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 432/852] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.114240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.213579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404b79-45d1-487d-97be-0bb4a8ed83a0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.241179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a234-d638-4a3f-95f0-09212385f130 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.253249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.254317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.254445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.254714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.255705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.256366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.257634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.280845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 433/853] 10.222.0.48 () {56 vars in 1135 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.282328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.285833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.287548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.288018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.288531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.289570 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=3f5322815d884ee89bf30f2b0fd84287) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.290066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.292727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc26de-30cf-4369-8778-d9512d4f088a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.301551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 421/854] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/role_assignments?user.id=3f5322815d884ee89bf30f2b0fd84287&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:14.394998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65601c9-bdec-45d1-8467-c373e881b413 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.397167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f96a-81de-4eff-9932-71a87a8bb0f6 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.397885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f96a-81de-4eff-9932-71a87a8bb0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.398380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f96a-81de-4eff-9932-71a87a8bb0f6 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.401962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 422/855] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:14.410146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fbd8-cd3d-4abc-b55a-3259fe5f978d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.410475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fbd8-cd3d-4abc-b55a-3259fe5f978d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.410698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fbd8-cd3d-4abc-b55a-3259fe5f978d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.428977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4ba7fbd8-cd3d-4abc-b55a-3259fe5f978d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:14.430211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4ba7fbd8-cd3d-4abc-b55a-3259fe5f978d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:14.438723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.439386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.439669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.439942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.503881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 423/856] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:14.505380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccb80-ef4e-470a-bc91-a63e7ce78f95 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.505668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccb80-ef4e-470a-bc91-a63e7ce78f95 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.505948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccb80-ef4e-470a-bc91-a63e7ce78f95 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.507211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 424/857] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:14.513817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.513980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.514342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.516218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.518451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.535535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:14.536985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:14.614816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 425/858] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:14.615994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.635721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 434/859] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:14.644799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.724699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4eb30-2207-499a-b991-97240b82c715 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.746555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478e141-1bd8-447f-b0a2-85af05046ddc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.762814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.763611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.763897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.764177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.764858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.766239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.778864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.779918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:14.781543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.782328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.782328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.782328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.782553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 426/860] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.782631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.782707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.793643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.795120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:14.813316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.814243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.815211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:14.815211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:14.815211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:14.815211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:14.815211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 435/861] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:14.815503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.886791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8182b-a2ff-4bd8-b1fd-39b961e3feb5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.914061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7fdb-6d26-4ba1-90d4-3aac43f48f1a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:14.926164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.927001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.927285 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.927561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.928212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.929605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:14.942030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:14.942993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:14.943879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 427/862] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:14.944771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:14.957520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:14.958187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:14.958474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:14.958751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:14.959475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:14.959761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:14.961237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:14.966586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 436/863] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:14.967636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.052624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e207a6-f5b5-4227-b104-cf75756289e3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.066809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85a963-dee7-46a6-944c-3eaf01901561 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.086374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.087040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.087921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.088182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.088937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.089244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.090607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.101694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.102353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.102484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 428/864] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:15.107179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.107179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.107179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.107402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.107490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.107490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.110169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 437/865] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:15.114718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.206914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634a7f-a03b-4ebc-aa96-95d91624f919 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.208041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ecf15-515c-41b9-8317-9bba1449b399 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.241945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.242985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.243117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.243343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.243595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.243763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.244666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.244951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.245664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.246204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.247333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.250409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.260660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.260883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 429/866] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:15.260883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:15.280659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:15.281650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:15.282551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:15.283002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 438/867] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:15.288359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.373130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d366d89-703d-423f-9a32-b0819355615d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.402626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062dd7c-fcb6-426a-a28b-6f99b8854ce9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.413519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.414190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.414523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.414803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.416071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.416484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.417898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.423511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 430/868] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:15.448690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.448690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.448690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.448690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.449502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.449830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.452063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0abcb8-64c1-43d6-b31e-9ddb02912a73 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.465873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 439/869] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:15.471524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:15.585124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043bfc1-187d-4676-bc1d-12b62f9b1c24 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:15.623124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:15.623781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:15.624067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:15.624385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:15.625229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=74292c819dee46f788c7b9af0b9fce7a) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:15.625546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:15.626988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b20e3-7b7f-4849-96a2-8b23f03a26cb None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:15.633387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 431/870] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:15 2022] GET /identity/v3/role_assignments?user.id=74292c819dee46f788c7b9af0b9fce7a&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:16.675648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594be-4526-4f3c-a60c-d33368c5ddd1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:16.676336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594be-4526-4f3c-a60c-d33368c5ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:16.676336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594be-4526-4f3c-a60c-d33368c5ddd1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:16.677858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 440/871] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:16.683854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:16.684362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:16.684540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:16.701010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:16.702169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:16.772382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 432/872] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:16.792565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec594be-4526-4f3c-a60c-d33368c5ddd1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:16.892832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec594be-4526-4f3c-a60c-d33368c5ddd1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:16.928929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:16.929742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:16.930027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:16.930302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:16.941307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:16.950315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:16.951319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:16.952181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 441/873] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:16.957682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.057748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c5c9b-8075-4211-95ec-55198f665947 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.093426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.094465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.094958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.095441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.096560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:17.097086 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.098658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.107590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 433/874] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:17.113831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.220139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749cd4-cd59-4bf0-8184-ff1613c46c2d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.254890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.256040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.256561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.257062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.269036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.270839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:17.288752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:17.289669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:17.290837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:17.290837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:17.290837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:17.290837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:17.293111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 442/875] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:17.303365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.400575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946b4d-7b52-4345-945a-7421becdf1af None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.439511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.440194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.440518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.440797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.441543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:17.441848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.443325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721aecd-a3b1-4d95-baf1-88c072f56cef None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.457337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 434/876] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:17.463300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.571110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a466ac7-ecf8-4526-bcc1-09947df0bae4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.611816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.612677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.612963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.613243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.613950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ee1-6f2e-48e7-aac7-7dbd7c61d9f3 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.614337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ee1-6f2e-48e7-aac7-7dbd7c61d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.614618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854ee1-6f2e-48e7-aac7-7dbd7c61d9f3 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.616220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 435/877] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:17.621686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.621831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.622013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.622247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.623286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:17.638369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:17.639370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:17.640629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:17.641181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:17.641267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 443/878] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:17.641344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:17.647258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.724528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 436/879] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:17.739231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.757068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15465c38-cab5-4acf-9a02-5dc5fb675c06 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.792079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.792779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.793060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.793331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.794164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:17.794475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.795905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f4cc5-5f1a-45c1-a797-246a09ac6ce3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.817375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 444/880] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:17.817375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9c65-9750-4996-bb2a-a1d9e1b0fe56 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.817375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9c65-9750-4996-bb2a-a1d9e1b0fe56 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.817375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9c65-9750-4996-bb2a-a1d9e1b0fe56 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.817375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 445/881] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:17.820772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f9c65-9750-4996-bb2a-a1d9e1b0fe56 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:17.842565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a142d-a8d5-484a-9713-7a91bb207f43 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.876200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.876899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.877182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.877457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.878174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:17.879542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cf06d-1300-4bac-b1fb-28c2828ac046 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:17.893268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 437/882] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:17 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:35:17.905955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.906166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.906535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:17.934671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:17.936933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:17.941201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f9c65-9750-4996-bb2a-a1d9e1b0fe56 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:17.991405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:17.992417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:17.993025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:17.993500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.022746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 438/883] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:18.042948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.083023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.084775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bbe83-a743-4923-99cd-22a54491e9a9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.152093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f02c2-756b-4ff2-80e1-3d805dc75b71 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.186711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.187385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.187666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.193404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.193577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 446/884] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:17 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:18.193671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.193745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd24b-dea7-467c-b26d-1c1e65e1879a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.193745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd24b-dea7-467c-b26d-1c1e65e1879a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.193870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493fd3-39df-46fd-adab-12679878871a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.193949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cd24b-dea7-467c-b26d-1c1e65e1879a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.193949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 447/885] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:18.195530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd24b-dea7-467c-b26d-1c1e65e1879a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.207131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 439/886] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:18 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:35:18.208451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.208745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.209028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.226585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:18.227827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:18.323877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 440/887] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:18.328592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cd24b-dea7-467c-b26d-1c1e65e1879a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.347839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.370689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.371964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.372534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.373047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.385041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.386958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:18.407075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.408026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.408968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:18.408968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:18.408968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:18.408968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:18.411329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 448/888] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.417781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.457272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8866b3-983b-47c8-85dc-cfb05e516936 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.494093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.494889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.495174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.495449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.496100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.497550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.510148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.511157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:18.511998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 441/889] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.517765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.551766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36d63e-c10a-442c-abb5-b33c570dea4b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.586479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.587684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.588045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.589045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.589172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.589473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.590851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.602683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 449/890] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:18.609143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.628045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacb222-ed20-458c-b688-4648977c2ee6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.662999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.664002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.664597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.665092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.666540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.667049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.668656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.674444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 442/891] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:18.684314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.724630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c89fd-5794-4fc9-a598-ad9f828a837a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.764832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.766624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.767091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.767517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.778032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.780426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.787762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3c8ef-4591-4fbc-a63d-e1bced679e95 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:18.801087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:18.802190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:18.803298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:18.806880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 450/892] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:18.811805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:18.831017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.832038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.832558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.833099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.833884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.834264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.835697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.840845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 443/893] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:18.922872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b7c1f-26e7-438c-b033-d72aee471f15 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:18.960595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:18.961529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:18.961983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:18.962951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:18.963914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:18.964397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:18.966005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ba302-61d9-4577-a8b6-19c5097b4f57 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:18.979909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 451/894] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:18.989391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:19.094533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f13feb-28ab-42a4-8f82-18058838aa5c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:19.129379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:19.130033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:19.130319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:19.130593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:19.131427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] RBAC: Adding query filter params (role.id=9fc481505fa94a64aefb1f11e1334e1b, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=3f5322815d884ee89bf30f2b0fd84287) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:19.131743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:19.133198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2966c5-c9cc-4822-8c47-46d792031d1b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:19.139204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 444/895] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:18 2022] GET /identity/v3/role_assignments?user.id=3f5322815d884ee89bf30f2b0fd84287&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=9fc481505fa94a64aefb1f11e1334e1b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:20.225983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c9fef-2069-40e6-9799-7a3ae5a1c34c None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.226528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c9fef-2069-40e6-9799-7a3ae5a1c34c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.226528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c9fef-2069-40e6-9799-7a3ae5a1c34c None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.228738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 452/896] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:20.234286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.234708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.234909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.252925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:20.254125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:20.326008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 445/897] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:20.349103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c9fef-2069-40e6-9799-7a3ae5a1c34c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.454012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c9fef-2069-40e6-9799-7a3ae5a1c34c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:20.488388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:20.489518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.489995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.490546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.491386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:20.492966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-68676d68-ecc4-4da0-aa60-c2552d05cee4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:20.504925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:20.505924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:20.506743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.514848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 453/898] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:20.516493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.610563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be87-05b0-4185-bcfa-efc857b28137 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.610898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be87-05b0-4185-bcfa-efc857b28137 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.611138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3be87-05b0-4185-bcfa-efc857b28137 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.612773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 454/899] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:20.617764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.617883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.618113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.632135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d30519-e880-4470-8f9f-8acda9126ae2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:20.636556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:20.637740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:20.674825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:20.675493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.675777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.676052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.676790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:20.677096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:20.678462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:20.687876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 446/900] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:20.689864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.736351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 455/901] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:20.759565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.809723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622b804-a17e-4b95-a896-913bf9e81502 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:20.857349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85e42e-e29c-4e44-bbe8-05c4e29fe8ec None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:20.858961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:20.860685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.861179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.861678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.862606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:20.863113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:20.865116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:20.872600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 447/902] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:20.878865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.902035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:20.903540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:20.904242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:20.905091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:20.906276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:20.908670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:20.925173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:20.926195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:20.927046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:20.934800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 456/903] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:20.937814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:20.990746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9ef03-d503-4cc5-87a9-31fc9c16e981 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.028252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.028990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.029123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.029401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.030199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] RBAC: Adding query filter params (interface=public, service_id=c299d35e1abe4b498eaf580956e72a74, region_id=RegionOne) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:21.031353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.031905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.042264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 448/904] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/endpoints?service_id=c299d35e1abe4b498eaf580956e72a74&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:21.043683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.072690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e49d5-6deb-442d-8a99-eba5da5acff4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.106399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.107105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.107391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.107663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.108450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:21.108696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.110064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.120035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 457/905] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:21.121984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.166393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ca45-0dca-41a6-9fed-765db2f561d2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.203441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.204126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.204471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.204749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.205441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.206842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d675973-279b-49b8-ba23-1dba35564db4 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.219871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 449/906] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:35:21.219871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24261e9-1bbc-495d-b0de-a7d7be10d807 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.219871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24261e9-1bbc-495d-b0de-a7d7be10d807 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.219871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24261e9-1bbc-495d-b0de-a7d7be10d807 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.219871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 450/907] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:21.224904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.225220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.225761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.244623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:21.245892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:21.250539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40efe5-5fd9-4a1c-86ee-c58244ac6785 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.288684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.289284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.289571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.290476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.291639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:21.291955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.293804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.301884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 458/908] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:21.308126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.328443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 451/909] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:21.354955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.427265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaab8a0-2fad-48fe-9215-844f1840ddf9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.461382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.462095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.462520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.462773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.463567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] RBAC: Adding query filter params (interface=public, service_id=8167944682ed499e96abe65cfe465ece, region_id=RegionOne) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:21.463879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.465285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e6402-c262-4ff0-872f-5f2a8090671c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.467810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28713-c5e3-4c52-a947-d332836044d5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.472317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 459/910] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/endpoints?service_id=8167944682ed499e96abe65cfe465ece&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:21.472317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733b445-ad1a-4277-9d96-2cef2d48fcb8 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.472317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733b445-ad1a-4277-9d96-2cef2d48fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.472317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733b445-ad1a-4277-9d96-2cef2d48fcb8 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.476416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 460/911] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:21.478863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.479151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.479434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.496516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:21.497688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:21.504557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.505640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.505927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.506205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.506920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.508297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.523181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 452/912] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:21 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:21.524300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.607272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 461/913] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:21.626051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.664258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d070e2c-5a29-42db-8d7a-c360c3e38453 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.710155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.710844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.711135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.711418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.712757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.714165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.724962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 453/914] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:35:21.741862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0955dd5-c6df-4907-954f-39795b197403 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.780454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.781628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.782087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.782542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.797316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:21.806223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:21.807234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:21.808114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 462/915] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:21.815523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:21.926481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ff51-5ba1-4cd4-91fd-93daaad5718a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:21.960982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:21.961653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:21.961941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:21.962859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:21.963839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:21.964149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:21.965619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:21.974363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 454/916] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:21.980428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.083190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e834f3-83db-4f4f-8997-8ba1671d7281 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.118046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.119911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.120325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.120739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.132315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.134005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:22.152411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:22.154094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:22.155873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:22.155873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:22.155873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:22.155873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:22.160307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 463/917] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:22.161796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.269015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd156-a424-43d7-a91b-77f82aa8a863 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.303302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.304207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.304704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.305136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.306518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:22.306979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.308582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.321595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 455/918] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:22.327430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.432985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a072c2-8d90-4f5f-ad42-2e7ae7cc6069 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.466717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.467535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.467817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.468090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.475987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.477484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:22.493177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:22.494763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:22.496325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 464/919] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:22.500691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.620141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31a6d2-6da4-4af1-9dfe-9f28ae48968b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.654469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.655142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.655430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.655710 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.656577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:22.656889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.658332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.676729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 456/920] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:22.682821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.783856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918b966-b77b-4684-9d19-49b9db81e912 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.819287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.820076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.820390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:22.820671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:22.831129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:22.832556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:22.849859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:22.850764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:22.851737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:22.851737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:22.851737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:22.851737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:22.851737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 465/921] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:22.858711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:22.962846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6332a-63e9-4a6a-b2c0-42d8cdb6298d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:22.998816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:22.999481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:22.999768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.000046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.000810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:23.001125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:23.002488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:23.014691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 457/922] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:23.019882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:23.125441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65467e-fb44-43b3-b70d-b05c33241386 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:23.158848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:23.159986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.160497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.160998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.168356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:23.170037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:23.185199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:23.186112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:23.186996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:23.189449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 466/923] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:23.194917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:23.299832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8ba6-ff5c-4f9e-8152-af32adc7232b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:23.333890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:23.334550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.334837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.335117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.335905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:23.336214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:23.338537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af5b7e-082c-4382-9503-cc494cb1650e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:23.351027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 458/924] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:23.356697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:23.459655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c9ed-1b1d-42c2-9b81-24c0382fe3c9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:23.494923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:23.496186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.496700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.497181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/3f5322815d884ee89bf30f2b0fd84287/roles/9fc481505fa94a64aefb1f11e1334e1b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.499674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=3f5322815d884ee89bf30f2b0fd84287, role_id=9fc481505fa94a64aefb1f11e1334e1b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:23.501374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bfd61-9d1c-4296-8188-8fd4480042eb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:23.517172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 467/925] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:23 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/3f5322815d884ee89bf30f2b0fd84287/roles/9fc481505fa94a64aefb1f11e1334e1b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:23.596754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502715-edfa-4229-912d-318379c3adff None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.597125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502715-edfa-4229-912d-318379c3adff None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.597312 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502715-edfa-4229-912d-318379c3adff None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.599124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 459/926] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:23.610419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.610761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.610994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.635339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:23.636952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:23.710813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 468/927] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:23.736674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502715-edfa-4229-912d-318379c3adff None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:23.851148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502715-edfa-4229-912d-318379c3adff None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:23.887320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:23.888114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.888429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.888703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.889354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:23.890707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-3701cd77-a607-4e24-ae73-8b4175f19279 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:23.902630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:23.903631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:23.904490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 460/928] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:23.911854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:23.985412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b4c-e71e-4e56-a968-1d6baf896b32 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.985412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b4c-e71e-4e56-a968-1d6baf896b32 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.985412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b4c-e71e-4e56-a968-1d6baf896b32 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:23.985412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 461/929] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:23.989538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:23.989827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:23.990157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.007422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:24.008646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:24.018533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a86b2-7726-461b-b897-68e37c378ca1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.052217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.052902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.053181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.053458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.054163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.054468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.056595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.061830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 469/930] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:24.067317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.085515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 462/931] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:24.107862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.185849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e4bad-026e-4924-b8e1-9e6bea0cddc2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.214027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb6efa-cd97-449c-aabe-eecc99795c77 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.217807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.218473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.218759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.219034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.219738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.220046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.221462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768ecfe-f2d4-47aa-9257-d57200a02be1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.231575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 470/932] 10.222.0.48 () {56 vars in 1114 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:24.231575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575eda-ab8f-4804-9830-88de61cca3fc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.231575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575eda-ab8f-4804-9830-88de61cca3fc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.231575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3575eda-ab8f-4804-9830-88de61cca3fc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.231575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 471/933] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:24.232593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575eda-ab8f-4804-9830-88de61cca3fc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.253819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.254576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.254860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.255138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.255794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.257200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c4e98d78-1915-4bd4-9149-5f3e9e821555 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:24.269347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:24.270381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:24.271363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 463/934] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:24.272175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.272855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.272855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.289727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:24.291169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:24.338237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3575eda-ab8f-4804-9830-88de61cca3fc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.357782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 464/935] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:24.358732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.373329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.374564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.375034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.375561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.376518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.378071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.408490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 472/936] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:24.409481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.489415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c7309-01ed-4430-96da-ac0c19cc7693 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.533335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a309f4-0d71-48d6-9348-ed425d73dbdf None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.537120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.538073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.538550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.539025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.539920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.540594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.542533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.548577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 465/937] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:24.561170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.575652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.577105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.578232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.578785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.579675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.582083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:24.601626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:24.604075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:24.604993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 473/938] 10.222.0.48 () {56 vars in 1132 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:24.610715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.688975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d4430-2f98-4ee5-8b42-493f51fb9eef None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.721505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958694b-4115-4c05-9444-8d043c2015bc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.737349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.738150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.738439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.738878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.739892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.740209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.741611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.752361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 466/939] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:24.755016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.762950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.763617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.763903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.764181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.764926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.765231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.766603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.771841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 474/940] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:24.779223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.873830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aa3eb-b51e-43de-be84-6ce52a2702dc None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.901282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56ad61-658c-4588-a4fe-e9507ae11c9f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:24.917046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.918335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.918978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.919436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.920726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] RBAC: Adding query filter params (interface=public, service_id=f3f02480c58d405ea24fdfbf491ec254, region_id=RegionOne) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.921227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.923216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.930666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 467/941] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/endpoints?service_id=f3f02480c58d405ea24fdfbf491ec254&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:24.936889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:24.944566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:24.945230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:24.945510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:24.945785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:24.947091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:24.947395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:24.949264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:24.960121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 475/942] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:24.964046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:25.056609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd62985-dddd-4922-bff1-9910cefa2258 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:25.080794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de505-3ce7-4aa9-a338-72474b177b90 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:25.100441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:25.101034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:25.101316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:25.101590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:25.102268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:25.105558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3341679-1163-45ea-afb3-d1266afcb3f3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:25.120538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 468/943] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:24 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:35:25.127073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:25.127668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:25.128012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:25.128309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:25.129112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:25.130520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaaa5-3a82-4845-b7fb-4eaa5e40650b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:25.156199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 476/944] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:25.857158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1dd4-da17-49d9-ba6a-9d4677b6b8e8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:25.857660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1dd4-da17-49d9-ba6a-9d4677b6b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:25.857764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1dd4-da17-49d9-ba6a-9d4677b6b8e8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:25.859306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 469/945] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:25.864628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:25.865022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:25.865190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:25.882868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:25.884175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:25.956669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 477/946] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:25.980394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d1dd4-da17-49d9-ba6a-9d4677b6b8e8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.081349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d1dd4-da17-49d9-ba6a-9d4677b6b8e8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.117320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.118060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.118421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.118421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.128525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:26.137274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:26.138200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:26.139127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 470/947] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:26.144572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.241427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40af9fa-876f-4e08-a5de-1c0b0a33dea1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.276737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.277454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.277734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.278006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.278848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:26.279152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:26.280533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:26.289259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 478/948] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:26.294387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.400690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15cd3-1d76-4380-9033-90611b432e54 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.435383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.436233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.436543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.436815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.448214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:26.449686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:26.467426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:26.469300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:26.470550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:26.470550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:26.470550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:26.470550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:26.470550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 471/949] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:26.474357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.580294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a89e3-b9bc-4086-af0b-2b854664e85e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.614387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.615065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.615345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.615617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.616390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:26.616697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:26.618657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:26.632189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 479/950] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:26.638135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.740413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11243-08fd-4c3f-9a03-c1b4195af21d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.777669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.778489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.778828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.779183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.787426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:26.788924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0d3537bb-1aff-495a-8366-667329b42f20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:26.804649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:26.805670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:26.806633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 472/951] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:35:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:26.816077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.816952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569a72-4cac-4460-b02b-fa7931ab1021 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.817314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569a72-4cac-4460-b02b-fa7931ab1021 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.817602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569a72-4cac-4460-b02b-fa7931ab1021 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.820214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 473/952] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:26.826422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db243-5050-423a-a844-5e97521dace3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.826848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db243-5050-423a-a844-5e97521dace3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.827223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db243-5050-423a-a844-5e97521dace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.845230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-697db243-5050-423a-a844-5e97521dace3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:26.846609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-697db243-5050-423a-a844-5e97521dace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:26.919659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 474/953] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:26.938526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fd75e-52e8-45dc-9cfc-0638ea0c87d5 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:26.947925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db243-5050-423a-a844-5e97521dace3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:26.983564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:26.984692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:26.985188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:26.985671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:26.986712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:26.987250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:26.988941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.009223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 480/954] 10.222.0.48 () {56 vars in 1149 bytes} [Tue May 10 16:35:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:27.014936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.078416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db243-5050-423a-a844-5e97521dace3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.126211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.127022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.127308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.127582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.128841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.130718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.131993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3635a-55ae-4e33-9134-acf1314699c0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.132112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING keystone.server.flask.common [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 16:35:27.154876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.sql.core [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:35:27.154876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 16:35:27.154876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [parameters: {'id': 'c6a0e5581afa45119de7395eb88c6f2f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 16:35:27.154876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91915) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:35:27.174225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.175231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.175747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.176333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6a0e5581afa45119de7395eb88c6f2f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6a0e5581afa45119de7395eb88c6f2f. May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application conn.query(q) May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:35:27.177851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application result.read() May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 16:35:27.178676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application next(self.gen) May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application yield resource May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application next(self.gen) May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise self.value May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application session.commit() May 10 16:35:27.179634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self.session.flush() May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application compat.raise_( May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:35:27.180622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:35:27.182082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application conn.query(q) May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application result.read() May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:35:27.182888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [parameters: {'id': 'c6a0e5581afa45119de7395eb88c6f2f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.183790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:27.186293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c6a0e5581afa45119de7395eb88c6f2f. May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 475/955] 10.222.0.48 () {60 vars in 1140 bytes} [Tue May 10 16:35:26 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:27.189223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.275319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.278371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.317428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259c0bc-2ddd-4b52-a429-8fa02e01ad92 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.359468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.360400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.360688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.360964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.371198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.373092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.391178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 481/956] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:27.397025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:27.398009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:27.398935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 476/957] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:27.400067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.405860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.516506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e23ec-d7ea-4a0b-917e-3919aa83a6e0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.542475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862220a-6daa-4bf3-b1bf-bedb6dc58636 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.557078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.558218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.558726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.559247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.570129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.571974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.584764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.585429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.585713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.585993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.586760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:27.587644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.589124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aeaf6e-b51e-4f99-b631-9f35d78afb47 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:27.595190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:27.596119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:27.597081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:27.597081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:27.597081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:27.597081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:27.599363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 482/958] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:27.605743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.618058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 477/959] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:27.648024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817504-dd88-4436-9b97-19cbbd1d6e12 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.648024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817504-dd88-4436-9b97-19cbbd1d6e12 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.648024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817504-dd88-4436-9b97-19cbbd1d6e12 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.654501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 478/960] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:27.656006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e2b1-7210-4446-a3ed-8a63d33339cf None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.656324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e2b1-7210-4446-a3ed-8a63d33339cf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.656616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e2b1-7210-4446-a3ed-8a63d33339cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.679419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ecc1e2b1-7210-4446-a3ed-8a63d33339cf None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:27.682305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ecc1e2b1-7210-4446-a3ed-8a63d33339cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:27.732884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623109af-25ac-4844-815e-a85f2c8c05bc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.753640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 479/961] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:27.761920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb45b1-340f-4927-9bae-7cfe65582b87 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.762279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb45b1-340f-4927-9bae-7cfe65582b87 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.762480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb45b1-340f-4927-9bae-7cfe65582b87 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.765613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 480/962] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:27.770204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.770594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.770969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.776142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.776861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.777148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.777423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.778181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:27.778491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.779901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.788511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:27.789712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:27.793132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 483/963] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:27.793921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.868828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 481/964] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:27.869608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.913863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0444dd3-f481-41d2-bdfc-ffd7cabd8252 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:27.948685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:27.949973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:27.950257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:27.950529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:27.951579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:27.953543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:27.969004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:27.970039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:27.976552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 484/965] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:27.977912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:27.977993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18682753-941f-40aa-b24b-dc8d0f1758b1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.009044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.009839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.010171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.010395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.017791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.019238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:28.036819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:28.037760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:28.038653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:28.039074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 482/966] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:28.041067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.082912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b87a8f-0a90-4acc-9ddd-5905cae52ca4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.123555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.124378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.125022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.125305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.126259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.127908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:28.143078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:28.144159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:28.145051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:28.145799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 485/967] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:28.146402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.148413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9585d4-f89c-4143-95ab-91434b6ec3c5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.183764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.184459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.184912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.185193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.186679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.186992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.188386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.193208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 483/968] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.198640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.252405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35775e89-2350-4ce4-987e-3e1998de04ae None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.290071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.291226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.291687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.291969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.292777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.293087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.294513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.299839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17aa23-203a-4177-a8f6-bcee8d477202 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.307106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 486/969] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.307934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.339197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.339782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.340073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.340383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.341093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.341403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.342772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.351914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 484/970] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.351914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.408137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eddd3-3136-40a3-aec9-71b0e785d9c4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.442314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.443072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.443353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.443674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.444413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.444741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.446106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.451326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01336f-6448-4bcc-8714-fddeb2e853f3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.451531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 487/971] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.453145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.486093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.486748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.487033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.487310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.488153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] RBAC: Adding query filter params (role.id=9fc481505fa94a64aefb1f11e1334e1b, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=3f5322815d884ee89bf30f2b0fd84287) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.488554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.489979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.495946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 485/972] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/role_assignments?user.id=3f5322815d884ee89bf30f2b0fd84287&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=9fc481505fa94a64aefb1f11e1334e1b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.496741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:28.586499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910eb8-6972-469a-9378-bfce19f90fda None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.619946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959be13a-126a-4b6b-9732-8da5e9ff8358 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:28.632221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.633043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.633334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.633612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.635717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:28.636044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.637647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1d54-9c2e-4206-b60e-0a9be2cafaf1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.644314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 488/973] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:28.669515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:28.670561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:28.671040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:28.671502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:28.672572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:28.674472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db346c1-fcde-413a-8b95-b876199fc059 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:28.700634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 486/974] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:29.989289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649fad-6804-4f67-998c-8efbe18ff373 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:29.989815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649fad-6804-4f67-998c-8efbe18ff373 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:29.989924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1649fad-6804-4f67-998c-8efbe18ff373 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:29.991415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 489/975] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:29.997208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:29.997626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:29.997770 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.015378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:30.016578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:30.089230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 487/976] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:30.114197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649fad-6804-4f67-998c-8efbe18ff373 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.217130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1649fad-6804-4f67-998c-8efbe18ff373 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.251280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.251879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.252165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.252467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.253173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.254607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.255901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING keystone.server.flask.common [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 16:35:30.268202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.sql.core [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:35:30.268202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 16:35:30.268202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [parameters: {'user_id': 'e396d5e1503f48af99b209ec98c23429', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 16:35:30.268202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application conn.query(q) May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result.read() May 10 16:35:30.277142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:35:30.278026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application next(self.gen) May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application yield resource May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application next(self.gen) May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.session.rollback() May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.force_reraise() May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise self.value May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application session.commit() May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 16:35:30.279787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._prepare_impl() May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.session.flush() May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._flush(objects) May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application compat.raise_( May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application flush_context.execute() May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rec.execute(self) May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 16:35:30.281023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 16:35:30.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result = self._query(query) May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application conn.query(q) May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application result.read() May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 16:35:30.282795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e396d5e1503f48af99b209ec98c23429', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:30.290642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 16:35:30.292693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:30.294824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 490/977] 10.222.0.48 () {60 vars in 1131 bytes} [Tue May 10 16:35:30 2022] POST /identity/v3/users => generated 160 bytes in 165 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:30.295713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.385291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62836-c07b-4161-b2af-5006cf4ec05f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.421031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.421829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.422109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.422379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.429902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.432029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f3c5f5e0-c1ef-4940-9bdb-92ecd3730208 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:30.447829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:30.450157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:30.452457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 488/978] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:30.459148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:30.574559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bcbe-d552-4953-974d-91eeac0b7e8e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:30.610594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:30.611264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.611551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.611826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.612667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:30.612974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:30.614606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec0ff3-f25c-4b75-b3a0-c7372803d485 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:30.653967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 491/979] 10.222.0.48 () {56 vars in 1101 bytes} [Tue May 10 16:35:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:30.964449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d266-3e8b-4ea8-91d5-5f662dd8c559 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.964449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d266-3e8b-4ea8-91d5-5f662dd8c559 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.964449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d266-3e8b-4ea8-91d5-5f662dd8c559 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.965129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 489/980] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:30.971135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adc17-bab8-4438-a328-5f7346e7a068 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.971292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.971462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.971698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.972080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adc17-bab8-4438-a328-5f7346e7a068 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.972549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7adc17-bab8-4438-a328-5f7346e7a068 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.974414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 490/981] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:30.981683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474796f-18ba-4a1d-b616-b4f5f65bc261 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:30.981965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474796f-18ba-4a1d-b616-b4f5f65bc261 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:30.982238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474796f-18ba-4a1d-b616-b4f5f65bc261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:30.995765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:30.997927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:31.007755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6474796f-18ba-4a1d-b616-b4f5f65bc261 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:31.009066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6474796f-18ba-4a1d-b616-b4f5f65bc261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:31.088151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 491/982] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:31.089750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314865-1fdf-4e09-aafc-87c851da94ae None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.090039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314865-1fdf-4e09-aafc-87c851da94ae None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.090362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84314865-1fdf-4e09-aafc-87c851da94ae None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.096389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 492/983] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:31.096565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 492/984] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:31.096927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.097276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.097559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.113585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.114715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:31.115901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:31.185396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 493/985] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:31.186240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.218429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcfe7-c13d-4982-9feb-359b74b639d9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.250834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.251572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.251923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.252281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.253072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.254449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.267039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 493/986] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:31 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:35:31.267824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.288553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ca334-2022-4c9e-9caf-1f24cd6fe918 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.335418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.336234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.336549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.337431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] PATH_INFO: `/v3/services/image` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.338165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.339489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:31.351485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:31.353429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:31.354298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 494/987] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:31.359843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.377292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4f61e-e552-4824-8c91-f7013f09319b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.412062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.412936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.413223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.413632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.414299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.415741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:31.428661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:31.429872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:31.430756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:31.435291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 494/988] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:31.436064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.465341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e9cc9-3aa8-4c4a-af4e-d70141cc9fee None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.499111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.499701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.499990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.500284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.500997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] RBAC: Adding query filter params (name=image) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:31.501305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.502667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.508391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 495/989] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:31.514344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.546933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbf56f-6fdd-4d42-8e97-182122d60568 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.584716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.585383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.585721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.586007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.587422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:31.588323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.589722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.594867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 495/990] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:31.600228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.615744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea515a1-a203-4b9f-a1d4-fcaac6231646 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.650405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.651070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.651361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.651641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.652380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] RBAC: Adding query filter params (type=image) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:31.652692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.654057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.668303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 496/991] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:31.709005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e2ee1-8b70-4fcb-801a-1777d2097dbe None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.744516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.745196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.745483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.745761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.746481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:31.746789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.748183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.753660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 496/992] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:31.760037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:31.862930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb305fee-61f2-44b7-ac14-ff656dac0e2f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:31.895602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:31.896263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:31.896580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:31.896849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:31.897648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] RBAC: Adding query filter params (interface=admin, service_id=f3f02480c58d405ea24fdfbf491ec254, region_id=RegionOne) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:31.897968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:31.899989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7d9c8-f921-470a-81ae-e09daf792093 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:31.909878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 497/993] 10.222.0.48 () {56 vars in 1249 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/endpoints?service_id=f3f02480c58d405ea24fdfbf491ec254&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:31.911131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:32.009417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082cd84-d95e-4b02-a508-4c249b02c5a3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:32.041435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:32.042099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:32.042378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:32.042648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:32.043326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:32.044726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681078b-21e8-4036-b3ca-3a2a86b77603 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:32.060308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 497/994] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:31 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:35:33.550812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f17f-9dc1-404d-add5-71eab7202e6c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:33.551331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f17f-9dc1-404d-add5-71eab7202e6c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:33.551411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f17f-9dc1-404d-add5-71eab7202e6c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:33.552801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 498/995] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:33.558565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:33.558949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:33.559128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:33.576143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:33.577668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:33.643278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 498/996] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:33.665792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f17f-9dc1-404d-add5-71eab7202e6c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:33.763529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f17f-9dc1-404d-add5-71eab7202e6c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:33.796333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:33.797160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:33.797443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:33.797720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] PATH_INFO: `/v3/services/compute` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:33.798392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:33.800064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:33.813240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:33.814269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:33.815154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:33.823484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 499/997] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:33.823709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:33.919510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ef4e-7316-4050-9a9e-0fd198abf4cd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:33.956051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:33.956741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:33.957026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:33.957302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:33.958003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:33.958310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:33.959680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5afe2-8045-449e-be8c-92c26e0dfd72 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:33.965103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 499/998] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:33.970528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.000767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f598f1-5a48-4719-9197-08bf486bbe5a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.001071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f598f1-5a48-4719-9197-08bf486bbe5a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.001339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f598f1-5a48-4719-9197-08bf486bbe5a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.002823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 500/999] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:34.007631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.007923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.008204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.026543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:34.027721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:34.068674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0754348-cece-4446-b476-dc4be9dfc50f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.098727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 501/1000] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:34.104668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.105350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.105631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.105904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.106627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] RBAC: Adding query filter params (type=compute) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:34.106931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.108345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.119461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 500/1001] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:34.120373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.124483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.218550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295ef8-cad9-4bd3-a39e-38cb96bb0c74 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.225192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7dc07-b721-4f26-84c3-727a93f9fd4f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.252760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.253431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.253718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.253996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.254784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] RBAC: Adding query filter params (interface=public, service_id=cc212ec3b3244bbaa39d792d5baad165, region_id=RegionOne) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:34.255100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.256503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.259195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.259915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.260197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.260517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.261246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.262594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53607937-d98a-4b5e-b7a2-61383f474961 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.267217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 502/1002] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:34 2022] GET /identity/v3/endpoints?service_id=cc212ec3b3244bbaa39d792d5baad165&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:34.268575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.277265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 501/1003] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:34 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:35:34.294255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07552281-ed77-4969-be89-01e1d2a424d0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.294555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07552281-ed77-4969-be89-01e1d2a424d0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.294836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07552281-ed77-4969-be89-01e1d2a424d0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.296483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 502/1004] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:34.302283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.302628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.302840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.321139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:34.322797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:34.374639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727047-c988-4c64-bde5-56c640371dd0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.399671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 503/1005] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:34 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:34.411746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.412467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.412758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.413036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.413733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.415968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.422353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.423480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 503/1006] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:34 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:35:34.540629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ab145-eac6-4a84-8c54-c30594041fcc None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.579712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.580562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.580840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.581111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.581772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.583170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:34.596563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:34.597718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:34.598600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 504/1007] 10.222.0.48 () {56 vars in 1126 bytes} [Tue May 10 16:35:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:34.604336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.700387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfffc2-63ca-45d4-83d6-0592e861b576 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.732144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.732826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.733106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.733378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.734074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:34.734382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.735745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.740530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 504/1008] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:34.746514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.846353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde239d4-098d-47f0-806e-279a6da1610c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:34.880183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:34.880879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:34.881165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:34.881494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:34.882193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:34.882524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:34.884665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df9b46-e464-45a0-95f2-8582b01da092 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:34.890768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 505/1009] 10.222.0.48 () {56 vars in 1122 bytes} [Tue May 10 16:35:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:34.895988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:34.994516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caf83d-f328-4ca7-b355-7edcfe4faa0a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:35.026347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:35.026995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:35.027276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:35.027548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:35.028304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:35.029657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443dba-c51f-4562-a218-73a675620f36 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:35.052313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 505/1010] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:36.550910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be4eb-b41a-4367-bc9f-e60ffba338bf None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.551494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be4eb-b41a-4367-bc9f-e60ffba338bf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.551494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654be4eb-b41a-4367-bc9f-e60ffba338bf None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.553106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 506/1011] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:36.559612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bd2d-77e7-4c19-8cdb-a3b6c719863a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.560144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bd2d-77e7-4c19-8cdb-a3b6c719863a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.560144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405bd2d-77e7-4c19-8cdb-a3b6c719863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.577710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f405bd2d-77e7-4c19-8cdb-a3b6c719863a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:36.578873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f405bd2d-77e7-4c19-8cdb-a3b6c719863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:36.647941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 506/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:36.670509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654be4eb-b41a-4367-bc9f-e60ffba338bf None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:36.737150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078bcc4-242a-491c-b6c9-4115d0b59e85 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.737441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078bcc4-242a-491c-b6c9-4115d0b59e85 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.737725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078bcc4-242a-491c-b6c9-4115d0b59e85 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.739350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 507/1013] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:36.745367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.745655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.745934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.763196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:36.764388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:36.773700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654be4eb-b41a-4367-bc9f-e60ffba338bf None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:36.807263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:36.807972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.808255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.808561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] PATH_INFO: `/v3/services/image` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.809210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:36.810573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:36.822651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:36.823700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:36.829523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 507/1014] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 10 16:35:36 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:36.832191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:36.832637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 508/1015] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:36.857872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:36.930788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634c19c-d9ad-4a93-b72c-b245b6230aa1 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:36.966003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:36.966638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:36.966921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:36.967184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:36.967878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] RBAC: Adding query filter params (name=image) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:36.968178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:36.968845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b039c93-d661-40bc-9eb4-bbc09c02d1b0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:36.969749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:36.974596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 508/1016] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:36.980067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.005515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.006472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.007070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.007356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] PATH_INFO: `/v3/services/compute` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.008808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.010804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:37.026050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:37.027059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:37.033035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 509/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:37.034223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.076887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f690-fb99-4155-95b6-4a73b2bddb5b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.110876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.111554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.111883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.112157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.112860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] RBAC: Adding query filter params (type=image) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:37.113168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.114562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.120670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 509/1018] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:37.126824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.151749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22806535-fbfc-43d0-8baf-a04462614ebb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.185741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.186632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.187118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.187546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.188426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:37.188906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.190422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.195701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 510/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:37.201545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.225453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae9b28-9732-4110-887d-3437feb38cea None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.259989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.260981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.261401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.261807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.262594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] RBAC: Adding query filter params (interface=public, service_id=f15c8e5e76f14461a0af39bea44e5671, region_id=RegionOne) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:37.262905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.264432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.275555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 510/1020] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:35:37 2022] GET /identity/v3/endpoints?service_id=f15c8e5e76f14461a0af39bea44e5671&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:37.276909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.298316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da408bf9-ac5a-42f3-9e12-166ac2ed8640 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.331222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.331794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.332098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.332402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.333099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:37.333401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.334756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da252-4435-442a-8914-30aff4908a56 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.339420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 511/1021] 10.222.0.48 () {56 vars in 1112 bytes} [Tue May 10 16:35:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:37.340619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6a64-f568-4c08-936a-6f0acdd56ffc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.340905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6a64-f568-4c08-936a-6f0acdd56ffc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.341180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b6a64-f568-4c08-936a-6f0acdd56ffc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.342542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 512/1022] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:37.345090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b6a64-f568-4c08-936a-6f0acdd56ffc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.373752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f742-bdb4-4923-8250-d415f64d76ca None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.404899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.405547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.405826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.406096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.406764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.408108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a7caf-dcc1-484f-9297-0f982f6495ba None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.414328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 511/1023] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:35:37 2022] GET /identity/v3/services => generated 1957 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:35:37.416041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.416313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.416593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.434493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:37.435806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:37.446814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b6a64-f568-4c08-936a-6f0acdd56ffc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.484811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.485747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.486030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.486304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.487047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.488467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.509403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 513/1024] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:37.538150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 512/1025] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:37.562734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.679312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded6fe4-d2aa-4c81-b853-e0a95b8883b4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.716651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.717453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.717739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.718049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.719258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.720733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798c0cb-0daa-4685-9fbf-d7976fc7fa40 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.722551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 514/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:37.729187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:37.833054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ba3eb-bbd7-4e92-88be-03ebb9571a14 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:37.867522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:37.868868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:37.869154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:37.869431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:37.870136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:37.871566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4bb1e-9916-4bcb-ac00-0bbd57d2a61c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:37.896508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 513/1027] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:35:37 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:39.674182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674d39-26da-4cdd-b2da-871e7810e139 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:39.674733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674d39-26da-4cdd-b2da-871e7810e139 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:39.674733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af674d39-26da-4cdd-b2da-871e7810e139 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:39.676367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 515/1028] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:39.682808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56ac7-99e1-464b-bff6-cdd0d79257d6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:39.683354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56ac7-99e1-464b-bff6-cdd0d79257d6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:39.683354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe56ac7-99e1-464b-bff6-cdd0d79257d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:39.700817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8fe56ac7-99e1-464b-bff6-cdd0d79257d6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:39.702005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8fe56ac7-99e1-464b-bff6-cdd0d79257d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:39.767378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 514/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:39.790627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af674d39-26da-4cdd-b2da-871e7810e139 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:39.861241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37558e21-792f-42b1-84d0-e9063227d0b8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:39.861557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37558e21-792f-42b1-84d0-e9063227d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:39.861804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37558e21-792f-42b1-84d0-e9063227d0b8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:39.863317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 515/1030] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:39.868842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:39.869224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:39.869596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:39.886626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:39.887792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:39.890569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af674d39-26da-4cdd-b2da-871e7810e139 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:39.925874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:39.926652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:39.926933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:39.927570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:39.927846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:39.929223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:39.941015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:39.942223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 16:35:39.943275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:39.945369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 516/1031] 10.222.0.48 () {56 vars in 1105 bytes} [Tue May 10 16:35:39 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:39.952473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:39.955155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 516/1032] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:39.981136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.053386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2df4a-b1b2-4f96-a287-cae016fb30f3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.078930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d635b7-898c-47c9-8e58-d77c22bec80c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.087938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.088894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.089361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.089845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.090706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] RBAC: Adding query filter params (name=image) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:40.091170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.092630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.097610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 517/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:40.103940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.113429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.114178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.114458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.114735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.124920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:40.133003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:40.133997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:40.134927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 517/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:40.140040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.203305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414aecf-6e08-47e5-9705-5c9e8e804a47 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.237378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.238036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.238135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ce2f8-b1c1-42e0-abfd-49abb47e9fd9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.238350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.238626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.239331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] RBAC: Adding query filter params (type=image) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:40.239642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.241050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7410201-5c62-4ef7-a258-cf6c5c4f7c67 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.245878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 518/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:40.247080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea4b3-7d11-4688-a0ca-02da7eaed27a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.247370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea4b3-7d11-4688-a0ca-02da7eaed27a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.247648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea4b3-7d11-4688-a0ca-02da7eaed27a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.252778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 519/1036] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:40.252778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea4b3-7d11-4688-a0ca-02da7eaed27a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.270068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.270729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.271011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.271289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.272031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:40.272367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.273730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239f477-7ecb-4767-bd7f-7cc492d20d7a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.282239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 518/1037] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:40.283480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.283771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.284046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.300126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:40.301322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:40.347700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea4b3-7d11-4688-a0ca-02da7eaed27a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.363704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 519/1038] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:40.364843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.383830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.384644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.384919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.385186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.385910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.387337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.404887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 520/1039] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:35:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:35:40.405702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.470518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a505af-fff1-4131-97a1-4a68a88fbc25 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.513029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.513389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a913-5a59-4505-a3cd-9c9ca81aa153 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.513820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.514102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.514374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.525645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.527124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:40.546365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:40.547373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:40.553737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:40.553737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:40.553737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:40.553737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:40.553737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 520/1040] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:40.554089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.555912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.556856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.557136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.557406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.558641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.560084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.561959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 521/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:40.567799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.662132 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4325bb6-faf0-4fce-8759-a9a2b7360cc7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.668135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775f492-39a9-4fa4-821a-930194d444ab None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.696410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.697221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.697512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.697789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.698508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:40.698815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.700171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.701605 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.702273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.702551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.702821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.703514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.704963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.715853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 521/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:40.717038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:40.739125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 522/1043] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:35:40 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:40.825616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155520-1453-4df0-871d-fcd8b828fef7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:40.860374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:40.861574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:40.862068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:40.862562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:40.871997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:40.873907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:40.889639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:40.890675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:40.891667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:40.893398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 522/1044] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:40.899108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.002467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee346-d26f-44f0-9970-c1e88a316eb7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.034417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.035083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.035362 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.035636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.036495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:41.036804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.038224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.055675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 523/1045] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:35:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:41.061452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.156964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c084-19e8-46a0-8f23-69fbc09056b7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.189540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.190188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.190464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.190737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.254534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.255909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.354800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 523/1046] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:41.356497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.449225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd55f65-4eb9-45df-b394-f5146fca940b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.481049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.482119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.482584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.483035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.493702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.495509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:41.513334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:41.514187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:41.515086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:41.515086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:41.515086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:41.515086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:41.521335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 524/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:41.522586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.631906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8e3e-59aa-42a8-9dcc-b493a410cb6b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.665966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.665966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.665966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.666329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.666768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:41.667077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.668503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.684975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 524/1048] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:41.685969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.779493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac18d8-a3b2-40b5-a3cf-c2af2e7e5d55 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.811749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.812566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.812854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.813191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.819898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.821940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:41.835225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:41.836099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:41.842370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 525/1049] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:41.842854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:41.941870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f238e-29d5-4b4a-9b88-fca805efb847 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:41.973898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:41.974560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:41.974847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:41.975121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:41.975908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:41.976219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:41.978296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d37a-3087-4353-b7a4-2aa258334dfb None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:41.995701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 525/1050] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:41.997009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:42.091533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7417c-df7d-4631-86c8-6e0676b1fa87 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:42.131405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:42.132061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:42.132513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:42.132800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:42.133665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] RBAC: Adding query filter params (role.id=9fc481505fa94a64aefb1f11e1334e1b, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:42.133977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:42.135406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a5fb7-0ad8-4c0f-807e-93010e114fb1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:42.148412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 526/1051] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:41 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=9fc481505fa94a64aefb1f11e1334e1b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:42.703146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d5d1f-1440-4818-b0ff-6db92f774e67 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:42.703506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d5d1f-1440-4818-b0ff-6db92f774e67 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:42.703693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d5d1f-1440-4818-b0ff-6db92f774e67 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:42.705142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 526/1052] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:42.710298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6927-ebe1-4f54-a8ae-88ea898e921e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:42.710684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6927-ebe1-4f54-a8ae-88ea898e921e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:42.711059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6927-ebe1-4f54-a8ae-88ea898e921e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:42.727904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-eccc6927-ebe1-4f54-a8ae-88ea898e921e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:42.729115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-eccc6927-ebe1-4f54-a8ae-88ea898e921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:42.791938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 527/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:42.814672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d5d1f-1440-4818-b0ff-6db92f774e67 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:42.918871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d5d1f-1440-4818-b0ff-6db92f774e67 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:42.952208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:42.952883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:42.953161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:42.953441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.018801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.020257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.023312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44124de-a9a7-400d-a2e2-5bd4e32e7d16 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.023606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44124de-a9a7-400d-a2e2-5bd4e32e7d16 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.024457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44124de-a9a7-400d-a2e2-5bd4e32e7d16 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.026109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 528/1054] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:43.030849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.031137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.031417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.047819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:43.049302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:43.116487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 529/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:43.121726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 527/1056] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:43.123048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.139596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.217615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0eeb-fdf2-4d7b-a245-ae44d1b6599b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.247023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac7d9d-5700-461d-87c0-d0b6d87c4a21 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.253395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.254189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.254472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.254745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.265307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.266754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.281253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.282039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.282324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.282599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:43.284836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:43.285716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 530/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:43.292655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.296729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:43.304616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:43.305653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:43.306581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 528/1058] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:43.311598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.395164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6414a-d316-4b60-bcff-ee8dcd566683 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.407728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5415d4-72cc-4f15-949d-763eea80bc25 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.429203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.429865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.430254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.430606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.431260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:43.431568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.432979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.443090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.443993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.444497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.444623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 531/1059] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:43.445069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.446385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:43.446891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.448215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.460331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 529/1060] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:43.464016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.571267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebfb2f-04ca-419d-a739-6a785d7fb79a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.611121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.612013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.612320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.612602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] PATH_INFO: `/v3/users/f6457b43170c42c6809f0d0f3593351d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.629686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] RBAC: Authorizing `identity:get_user(user_id=f6457b43170c42c6809f0d0f3593351d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.631146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.635181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 532/1061] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/users/f6457b43170c42c6809f0d0f3593351d => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:43.639036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:43.739708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8020-f4b5-4022-af2b-97a1564c47d7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:43.773707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:43.774477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:43.774759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:43.775033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:43.838506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:43.839882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:43.932301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 530/1062] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:43.938042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:44.034615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf8f78-b0db-42dd-9b5d-c329082f7939 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:44.066918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:44.067767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.068049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.068350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.069516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:44.071568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d92b61-a10c-4579-8c3b-81d7156a7aeb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:44.073511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 533/1063] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:35:43 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:44.079553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:44.182539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abb147-fa71-45f4-a179-e853a0a9f1d6 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:44.215900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:44.216578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.216861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.217134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.217952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=3e265eb2d85946e69d68d566b5c46a84, user.id=f6457b43170c42c6809f0d0f3593351d) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:44.218263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:44.219688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a307cb3-9c54-4a2e-9946-88164a9aed61 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:44.224986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 531/1064] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:44 2022] GET /identity/v3/role_assignments?user.id=f6457b43170c42c6809f0d0f3593351d&scope.project.id=3e265eb2d85946e69d68d566b5c46a84&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:44.348906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03d46-83fd-45e1-b10c-54243bf5692d None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.349191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03d46-83fd-45e1-b10c-54243bf5692d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.349469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d03d46-83fd-45e1-b10c-54243bf5692d None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.350856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 534/1065] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:44.357070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.357361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.357639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.375720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:44.376982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:44.442550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 532/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:44.466097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03d46-83fd-45e1-b10c-54243bf5692d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:44.566113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d03d46-83fd-45e1-b10c-54243bf5692d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:44.599328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:44.600132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.600451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.600728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.610689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:44.619286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:44.620261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:44.621139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:44.624423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 535/1067] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:44.626396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:44.718725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94896-c553-4f9f-9827-14e51036e66f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:44.750274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:44.750928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.751209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.751480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.752213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:44.752544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:44.753885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:44.762039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 533/1068] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:44.767827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:44.861293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf1e04-eaaa-454f-a48f-25428f322fb2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:44.893763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:44.894563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:44.894845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:44.895119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:44.910269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:44.911734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:44.929129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:44.930655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:44.931729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:44.931729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:44.931729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:44.931729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:44.931729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 536/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:44.937002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.030153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9cd2e-b72c-4560-8fb8-5e9e0226824a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.062254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.062909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.063189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.063461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.064172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:45.064503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.065861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.077242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 534/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:45.082816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.176980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655899-504d-46dc-87f9-9c1f6c69d16a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.208430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.209207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.209488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.209762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.217329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.218763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:45.232236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:45.233376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:45.234624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:45.236429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 537/1071] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:45.239053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.332116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349314be-d669-4915-b33d-dc346bef0dd9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.368436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.369122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.369405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.369679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.370531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:45.370840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.372325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.390678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 535/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:45.396203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.488410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dc2c2-19da-4427-8fa0-eb00af3da706 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.520293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.521077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.521390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.521699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.532046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.533541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:45.550191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:45.551318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:45.552752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:45.552752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:45.552752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:45.552752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:45.552752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 538/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:45.557676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.654187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d42efc-6224-45eb-b6df-5051bff82c86 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.686436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.687084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.687363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.687633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.688363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:45.688693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.690036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.700628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 536/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:45.706229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.798986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-6ed0-4d7b-b4ed-b514204e2bd0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.830501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.831282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.831570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.831848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.838411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.839856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:45.854213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:45.855251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:45.856182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 539/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:45.861391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:45.955422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6c527-7d69-4f3c-b296-d1d97cb9504a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:45.987544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:45.988193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:45.988501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:45.988772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:45.989547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:45.989852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:45.991263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83826f3e-1c76-4670-92f3-1957816e01f6 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:46.002570 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 537/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:46.008994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:46.102075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776275fb-f13d-41fe-83e1-160d85416ea0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:46.135459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:46.136364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:46.136648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:46.136921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/9fc481505fa94a64aefb1f11e1334e1b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:46.139092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=7e2c583bb342443e935446db4b26dcd7, role_id=9fc481505fa94a64aefb1f11e1334e1b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:46.140559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713aa9c-260f-4dc2-afdf-e8a1a6b4bc62 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:46.153031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 540/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:46 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/7e2c583bb342443e935446db4b26dcd7/roles/9fc481505fa94a64aefb1f11e1334e1b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:35:46.526065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab56f5-38e7-4be8-a5a2-333b1180ec24 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:46.526532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab56f5-38e7-4be8-a5a2-333b1180ec24 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:46.526821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab56f5-38e7-4be8-a5a2-333b1180ec24 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:46.528201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 538/1078] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:46.533817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:46.534115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:46.534392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:46.550694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:46.551849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:46.616284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 541/1079] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:46.638744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab56f5-38e7-4be8-a5a2-333b1180ec24 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:46.734031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab56f5-38e7-4be8-a5a2-333b1180ec24 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:46.765905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:46.766689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:46.766971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:46.767246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:46.777469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:46.784908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:46.786028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:46.786911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 539/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:46.792668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:46.884774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c782a5-db5d-4048-8029-2401ea7dce1f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:46.917366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:46.918021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:46.918297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:46.918565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:46.919298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:46.919598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:46.920978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:46.929038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 542/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:46.935780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:47.038868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65918-e80d-4994-a512-1509ba08931d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:47.070371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:47.071890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:47.072169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:47.072474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] PATH_INFO: `/v3/users/f6457b43170c42c6809f0d0f3593351d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:47.073646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] RBAC: Authorizing `identity:get_user(user_id=f6457b43170c42c6809f0d0f3593351d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:47.075067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:47.076711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 540/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:46 2022] GET /identity/v3/users/f6457b43170c42c6809f0d0f3593351d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:47.082412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:47.176985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4db406-a90c-4280-b242-1893327f28d7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:47.209365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:47.210222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:47.210506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:47.210783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:47.212522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:47.213958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db7160-1c86-45ec-8874-860fe4e3fca2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:47.215644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 543/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:35:47 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:47.221471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:47.333870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb32e9-af9f-4d14-9a86-837b3fa21c98 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:47.376282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:47.377234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:47.377535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:47.377967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84/users/f6457b43170c42c6809f0d0f3593351d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:47.380717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=3e265eb2d85946e69d68d566b5c46a84, user_id=f6457b43170c42c6809f0d0f3593351d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:47.382696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30987a4b-b8d2-4622-aed7-c7e1df6d9b5c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:47.397788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 541/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:47 2022] PUT /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84/users/f6457b43170c42c6809f0d0f3593351d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:35:48.408493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cec0-7407-4009-8954-546f964210ce None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:48.409053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cec0-7407-4009-8954-546f964210ce None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:48.409053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6cec0-7407-4009-8954-546f964210ce None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:48.410415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 544/1085] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:48.416051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:48.416504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:48.416655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:48.433803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:48.434977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:48.501561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 542/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:48.525266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6cec0-7407-4009-8954-546f964210ce None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:48.621129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6cec0-7407-4009-8954-546f964210ce None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:48.653140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:48.653936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:48.654217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:48.654490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:48.664050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:48.672806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:48.674173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:48.676145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 545/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Tue May 10 16:35:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:48.680749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:48.772439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb0b8e-94b8-4163-b569-80412f483d10 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:48.804106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:48.804815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:48.805107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:48.805381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:48.806111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:48.806418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:48.807791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:48.815294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 543/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:35:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:48.821494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:48.915118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57a76b-579b-4368-a5ac-d0a95834a89e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:48.946903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43452077-513d-4341-8f89-3863e3180723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:48.947676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43452077-513d-4341-8f89-3863e3180723 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:48.947961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43452077-513d-4341-8f89-3863e3180723 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:48.948236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43452077-513d-4341-8f89-3863e3180723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:48.958242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43452077-513d-4341-8f89-3863e3180723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:48.959687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43452077-513d-4341-8f89-3863e3180723 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-43452077-513d-4341-8f89-3863e3180723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:48.977458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:48.978346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:48.979282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:48.979282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:48.979282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:48.979282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:48.979282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 546/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:48.984343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.079418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21b0c5-9b37-4780-942b-14d99d532777 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.111998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.112697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.112985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.113263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.113989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:49.114298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.115660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:49.127687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 544/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:49.133902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43452077-513d-4341-8f89-3863e3180723 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.229603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43452077-513d-4341-8f89-3863e3180723 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.261980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.262852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.263140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.263413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.270620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.272068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:35:49.285984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:49.287099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:49.292780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 547/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:49.293419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.397566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc9cf8-fc95-4bc8-a214-b3032a0dec99 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.434478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.435134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.435420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.435691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.436565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:49.436879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.438303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020005ad-1594-4a23-b67d-5d4740722691 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:49.455347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 545/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:49.461136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.557464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7354b5-97f5-4be5-9dd3-698f3465ace3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.592159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02acd14-3ba7-40a1-bb5d-260446de773f None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.592476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02acd14-3ba7-40a1-bb5d-260446de773f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.592751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02acd14-3ba7-40a1-bb5d-260446de773f None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.593304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.593946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.594146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 546/1093] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:35:49.594256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.594487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.599075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.599356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.599629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.615188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:49.616367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:49.659184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.660658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:49.681493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 547/1094] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:35:49.705014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.753977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 548/1095] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:35:49.760022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.800871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0847-fac3-4d34-a2c5-aabd1edc4c34 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.833660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.834372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.834653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.834934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.845439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:35:49.849984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e013f-3d72-4170-bacc-8983b866edcc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:35:49.854097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:49.855195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:35:49.856061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 548/1096] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:49.861116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.881980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.882761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.883179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.883457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.893015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.894462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:35:49.911678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:49.912658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:49.913564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:35:49.913564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:35:49.913564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:35:49.913564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:49.913564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 549/1097] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:35:49.919032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:49.955716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d8c7-7618-4b6f-9b3e-08f4f6bfd8d7 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:49.988210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:49.988903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:49.989190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:49.989468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:49.990215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:49.990525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:49.991888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.000033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 549/1098] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.005625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.010364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27bd4-3e6b-4941-bafb-151153a58efc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.042821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.043478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.043758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.044035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.044783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:50.045093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.046456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.057382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 550/1099] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.062862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.099354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0fe0-4291-437a-bd73-c078743c7f4c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.131036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.131900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.132191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.132494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] PATH_INFO: `/v3/users/f6457b43170c42c6809f0d0f3593351d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.134590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] RBAC: Authorizing `identity:get_user(user_id=f6457b43170c42c6809f0d0f3593351d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.136015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.137666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 550/1100] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/users/f6457b43170c42c6809f0d0f3593351d => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.143237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.157217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38da66-1f66-4e5d-a750-a96a87623e0a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.188178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.188979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.189261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.189531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.196488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.197902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:35:50.212596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:35:50.213683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:35:50.214609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 551/1101] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:35:50.219727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.239551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56310779-3d0e-4bef-97c4-ced4d8741d42 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.271048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.271681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.271961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.272233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.313153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6a27-69a0-41cb-88ee-039bfdd97f0a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.334599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.336698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.345311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.345950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.346232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.346505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.347280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:50.347585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.349012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.359920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 552/1102] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.365784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.427812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 551/1103] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 16:35:50.433776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.458163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c4c93-db99-4d89-afc8-f663e92aaf36 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.489482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.490103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.490391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.490666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.491484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] RBAC: Adding query filter params (role.id=9fc481505fa94a64aefb1f11e1334e1b, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=7e2c583bb342443e935446db4b26dcd7) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:50.491793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.493396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.498959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 553/1104] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/role_assignments?user.id=7e2c583bb342443e935446db4b26dcd7&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=9fc481505fa94a64aefb1f11e1334e1b => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.530153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a11361-9123-45b1-a808-cf7bbb3f1442 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.565994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.566882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.567166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.567443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.568777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.570242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd178-eb0f-4aa2-9c96-779a8dd5f98a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.577790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 552/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:50.578908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:50.683081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925de5-ea7f-410f-9caa-fd6f7852ddb7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:50.716008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:50.716698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:50.716985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:50.717260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:50.718090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=3e265eb2d85946e69d68d566b5c46a84, user.id=f6457b43170c42c6809f0d0f3593351d) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:50.718405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:50.719845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f6c84-6935-4250-98d9-641de244f255 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:50.726280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 554/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:50 2022] GET /identity/v3/role_assignments?user.id=f6457b43170c42c6809f0d0f3593351d&scope.project.id=3e265eb2d85946e69d68d566b5c46a84&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:35:52.963763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66922-3fd3-4f49-a19a-d0dd6e100fd5 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:52.964347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66922-3fd3-4f49-a19a-d0dd6e100fd5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:52.964347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66922-3fd3-4f49-a19a-d0dd6e100fd5 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:52.965739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 553/1107] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:52.971168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:52.971582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:52.971724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:52.987977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:52.989176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:53.064704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 555/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:53.094614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66922-3fd3-4f49-a19a-d0dd6e100fd5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:53.191186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66922-3fd3-4f49-a19a-d0dd6e100fd5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:53.222050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:53.222758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:53.223035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:53.223303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:53.224467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:53.225882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a621ed-da7d-4036-9f40-ef1914914b2a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:53.227988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 554/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:35:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:53.233761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:53.326619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699a954-f51d-435e-8036-12ac3ef079ef None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:53.358665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:53.359324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:53.359609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:53.359887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:53.360625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:53.362052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a4bd7-dbbf-4d80-b806-664ee7705311 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:53.381990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 556/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:35:53 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:35:55.663393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f59d-19af-4d7a-adea-9af4ed4b8d70 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:55.663937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f59d-19af-4d7a-adea-9af4ed4b8d70 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:55.663937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f59d-19af-4d7a-adea-9af4ed4b8d70 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:55.665895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 555/1111] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:55.671186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:55.671577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:55.671768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:55.688037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:55.689240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:55.751442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 557/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:55.775178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269f59d-19af-4d7a-adea-9af4ed4b8d70 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:55.869950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269f59d-19af-4d7a-adea-9af4ed4b8d70 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:55.901384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:55.902216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:55.902500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:55.902775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] PATH_INFO: `/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:55.904229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] RBAC: Authorizing `identity:get_role(role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:55.905610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:55.906954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 556/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:55 2022] GET /identity/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:55.912543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:56.003772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e7af8-d356-4ed7-a18b-dad34c304651 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:56.035125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:56.035971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:56.036252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:56.036557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] PATH_INFO: `/v3/users/b31d70d754514e978a08b6a00c095093` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:56.048919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] RBAC: Authorizing `identity:get_user(user_id=b31d70d754514e978a08b6a00c095093)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:56.050354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:56.051958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 558/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:55 2022] GET /identity/v3/users/b31d70d754514e978a08b6a00c095093 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:56.058044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:56.150650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c8c7b-a447-434f-a550-5cbf3f2fac3f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:56.183643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:56.184297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:56.184598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:56.184880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:56.255186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:56.257875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:56.350976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 557/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:35:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:35:56.357275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:56.452910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda975c3-de67-458e-9919-15113d235f98 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:56.485266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:56.486108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:56.486395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:56.486674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:56.487834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:56.489354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c59b5-8bef-43e2-8b4b-b0f1fc29a1b4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:56.491028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 559/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:35:56 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:56.497140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:56.589652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad4655-b2d4-4350-903b-b262821dfc4f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:56.621533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:56.622179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:56.622466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:56.622741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:56.623564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=3e265eb2d85946e69d68d566b5c46a84, user.id=b31d70d754514e978a08b6a00c095093) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:35:56.623878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:56.625335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9280f1b-ddaf-43b6-aeed-e1a2b967ee48 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:56.630498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 558/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:35:56 2022] GET /identity/v3/role_assignments?user.id=b31d70d754514e978a08b6a00c095093&scope.project.id=3e265eb2d85946e69d68d566b5c46a84&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:58.798928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd36c2-f911-4228-973e-dcfa8c7d1f77 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:58.799447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd36c2-f911-4228-973e-dcfa8c7d1f77 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:58.799558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd36c2-f911-4228-973e-dcfa8c7d1f77 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:58.800936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 560/1118] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:35:58.806753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:58.807189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:58.807315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:58.823963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:35:58.825185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:35:58.888208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 559/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:35:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:35:58.910456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd36c2-f911-4228-973e-dcfa8c7d1f77 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:59.004867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd36c2-f911-4228-973e-dcfa8c7d1f77 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:59.035808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:59.036667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:59.036946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:59.037217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] PATH_INFO: `/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:59.038631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] RBAC: Authorizing `identity:get_role(role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:59.040245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:59.041617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 561/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:58 2022] GET /identity/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:59.047264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:59.141199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b534e9e-e229-45ff-9cad-11f3df024108 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:59.172958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:59.174063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:59.174343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:59.174615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] PATH_INFO: `/v3/users/b31d70d754514e978a08b6a00c095093` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:59.175779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] RBAC: Authorizing `identity:get_user(user_id=b31d70d754514e978a08b6a00c095093)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:59.177350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:59.178934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 560/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:35:59 2022] GET /identity/v3/users/b31d70d754514e978a08b6a00c095093 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:59.185265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:59.277526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c8b23-302b-46b5-9945-d5971182463d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:59.309052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:59.309882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:59.310158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:59.310426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:59.311601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:59.313069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a143-27c8-47b6-8f7e-ce7141c766ac None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:59.314713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 562/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:35:59 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:35:59.320469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:35:59.412411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47c189-ea54-4e9f-a7b9-081590600909 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:35:59.445218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:35:59.446168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:35:59.446449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:35:59.446728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84/users/b31d70d754514e978a08b6a00c095093/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:35:59.448942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e265eb2d85946e69d68d566b5c46a84, user_id=b31d70d754514e978a08b6a00c095093, role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:35:59.450368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed48f0-05e8-43f8-a9a2-945dfddf0898 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:35:59.462407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 561/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:35:59 2022] PUT /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84/users/b31d70d754514e978a08b6a00c095093/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:36:01.711011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3944-db85-48b1-9553-6d07cd967c59 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:01.711588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3944-db85-48b1-9553-6d07cd967c59 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:01.711588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3944-db85-48b1-9553-6d07cd967c59 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:01.712949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 563/1124] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:01.718269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:01.718697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:01.718833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:01.735377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:01.736593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:01.799330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 562/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:01.822325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa3944-db85-48b1-9553-6d07cd967c59 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:01.916940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa3944-db85-48b1-9553-6d07cd967c59 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:01.948425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:01.949251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:01.949530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:01.949802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] PATH_INFO: `/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:01.951230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] RBAC: Authorizing `identity:get_role(role_id=1f69dcb5aa394a0ea6982a3bb3413ee1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:01.952613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:01.953940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 564/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:01 2022] GET /identity/v3/roles/1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:01.959555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:02.051456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53226d-0121-4b72-a7b3-3bf0aa0c6a57 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:02.082472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:02.083318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:02.083601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:02.083877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] PATH_INFO: `/v3/users/b31d70d754514e978a08b6a00c095093` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:02.085084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] RBAC: Authorizing `identity:get_user(user_id=b31d70d754514e978a08b6a00c095093)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:02.087083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:02.088700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 563/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:01 2022] GET /identity/v3/users/b31d70d754514e978a08b6a00c095093 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:02.094253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:02.186508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292af20a-81f8-4c21-a2c1-7538056ba263 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:02.218035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:02.218661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:02.218944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:02.219216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:02.280956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:02.282396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:02.373546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 565/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:02.379818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:02.483758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3d2a-6970-4659-ac6b-9d25d1652817 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:02.525716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:02.526561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:02.526843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:02.527118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] PATH_INFO: `/v3/projects/3e265eb2d85946e69d68d566b5c46a84` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:02.528309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] RBAC: Authorizing `identity:get_project(project_id=3e265eb2d85946e69d68d566b5c46a84)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:02.529733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb904f-bcbf-4210-b500-581673e872e5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:02.531429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 564/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:02 2022] GET /identity/v3/projects/3e265eb2d85946e69d68d566b5c46a84 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:02.537534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:02.631395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefdd8b-6246-4c46-b37a-95ce0b7957ed None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:02.662951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:02.663591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:02.664438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:02.664716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:02.665532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] RBAC: Adding query filter params (role.id=1f69dcb5aa394a0ea6982a3bb3413ee1, scope.project.id=3e265eb2d85946e69d68d566b5c46a84, user.id=b31d70d754514e978a08b6a00c095093) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:02.665841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:02.667259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6aee64-7c5f-4df4-9379-24020e5636b6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:02.672794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 566/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:36:02 2022] GET /identity/v3/role_assignments?user.id=b31d70d754514e978a08b6a00c095093&scope.project.id=3e265eb2d85946e69d68d566b5c46a84&role.id=1f69dcb5aa394a0ea6982a3bb3413ee1 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:04.890217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c9839-31c8-4cf2-bda7-95c423879d1d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:04.890759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c9839-31c8-4cf2-bda7-95c423879d1d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:04.890759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c9839-31c8-4cf2-bda7-95c423879d1d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:04.892137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 565/1131] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:04.897358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:04.897749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:04.897956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:04.913896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:04.915046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:04.976499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 567/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:05.000238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c9839-31c8-4cf2-bda7-95c423879d1d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:05.096748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c9839-31c8-4cf2-bda7-95c423879d1d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:05.137168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:05.138087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:05.138376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:05.138660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:05.139838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:05.141347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadad8-d9f7-4bcb-aa8e-2af25f61f36f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:05.142911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 566/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:05.149047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:05.242627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badbcc-9a76-4c0c-8a58-a691f120755c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:05.273492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:05.274016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:05.274300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:05.274576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:05.275268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:05.276726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1f53e-61d4-45f8-ae19-a39510071916 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:05.300666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 568/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:36:05 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:36:07.537160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cab1-8e89-48d4-8966-712211a779a8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:07.537682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cab1-8e89-48d4-8966-712211a779a8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:07.537801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7cab1-8e89-48d4-8966-712211a779a8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:07.539740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 567/1135] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:36:07.544989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:07.545391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:07.545547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:07.562402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:07.563553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:07.624875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 569/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 16:36:07.649205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7cab1-8e89-48d4-8966-712211a779a8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:07.745106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7cab1-8e89-48d4-8966-712211a779a8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:07.776469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:07.777228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:07.777512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:07.777784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:07.778937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:07.780385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784937-b23e-49cd-b6e0-9f2365756f88 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:07.781981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 568/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:36:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:36:07.787692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:07.879350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d993f-929b-4bc0-b76a-23a20b298f80 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:07.911118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:07.911766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:07.912047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:07.912344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:07.913048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:07.915055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2b996-2d0e-447f-af1d-5e8811e008d3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:07.933706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 570/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:36:07 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:36:10.185995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831e2-0851-4249-a2a8-db24033f92de None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.186564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831e2-0851-4249-a2a8-db24033f92de None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.186564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00831e2-0851-4249-a2a8-db24033f92de None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.187926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 569/1139] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:10.193090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.193464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.193646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.210373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:10.211701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:10.274178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 571/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:10.297721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00831e2-0851-4249-a2a8-db24033f92de None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:10.396965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00831e2-0851-4249-a2a8-db24033f92de None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:10.430328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:10.431109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.431395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.431674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.442581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:10.449993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:10.451094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:10.452020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 570/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:10.457303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:10.556792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7c54d-aa53-4d2f-9ae1-b73a249023a6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:10.588026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:10.588720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.589005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.589278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.590027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:10.590328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:10.591690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:10.599275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 572/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:10.605889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:10.698615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fff41-944e-415c-8616-319cf4ccbb8b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:10.729893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:10.730742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.731022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.731293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] PATH_INFO: `/v3/users/1d4959515cd940abac1712b4c287f539` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.744383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] RBAC: Authorizing `identity:get_user(user_id=1d4959515cd940abac1712b4c287f539)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:10.745805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:10.747397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 571/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:10 2022] GET /identity/v3/users/1d4959515cd940abac1712b4c287f539 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:10.753092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:10.847690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e62b-6ca3-4944-96d9-4ab0353f292f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:10.878893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:10.879526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:10.879811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:10.880087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:10.942254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:10.943687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:11.033852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 573/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:11.040214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:11.132826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a08fbb-72ff-4bed-95b0-5ae0130c2d5b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:11.164031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:11.164939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:11.165218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:11.165485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] PATH_INFO: `/v3/projects/9c7d815df7c246e79d41bdf836c42cb6` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:11.166644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] RBAC: Authorizing `identity:get_project(project_id=9c7d815df7c246e79d41bdf836c42cb6)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:11.168056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb48b8-7c54-4757-a795-92e7945f1b25 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:11.169730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 572/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:11 2022] GET /identity/v3/projects/9c7d815df7c246e79d41bdf836c42cb6 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:11.176045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:11.268007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6585f4a-b41a-472d-8c05-a5eea5323850 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:11.299669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:11.300249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:11.300559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:11.300835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:11.301650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=9c7d815df7c246e79d41bdf836c42cb6, user.id=1d4959515cd940abac1712b4c287f539) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:11.301962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:11.303380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e58f9a-71ef-45d2-b08a-cb5f7c4bb416 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:11.308542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 574/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:36:11 2022] GET /identity/v3/role_assignments?user.id=1d4959515cd940abac1712b4c287f539&scope.project.id=9c7d815df7c246e79d41bdf836c42cb6&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:13.490754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648944-9042-42b2-8d09-589b5bc5d4a5 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:13.491356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648944-9042-42b2-8d09-589b5bc5d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:13.491949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7648944-9042-42b2-8d09-589b5bc5d4a5 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:13.493362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 573/1147] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:13.498788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:13.499194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:13.499339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:13.515502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:13.516691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:13.578870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 575/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:13.602017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648944-9042-42b2-8d09-589b5bc5d4a5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:13.707252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7648944-9042-42b2-8d09-589b5bc5d4a5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:13.738954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:13.739726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:13.740003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:13.740299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:13.750513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:13.758718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:13.759689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:13.760657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 574/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:13.765982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:13.859278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a92be8-cd32-4592-b9d6-225d07d51e40 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:13.890241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:13.890893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:13.891177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:13.891450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:13.892184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:13.892517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:13.893874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:13.902056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 576/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:13.907713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:14.001396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddfb2-d6ca-446a-992d-f15c5dd70584 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:14.032395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:14.033230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:14.033508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:14.033777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] PATH_INFO: `/v3/users/1d4959515cd940abac1712b4c287f539` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:14.034922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] RBAC: Authorizing `identity:get_user(user_id=1d4959515cd940abac1712b4c287f539)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:14.036343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:14.037915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 575/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:13 2022] GET /identity/v3/users/1d4959515cd940abac1712b4c287f539 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:14.043515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:14.136266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33145a2-0541-4910-9b1a-62e67c805dd1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:14.167409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:14.168240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:14.168554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:14.168829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] PATH_INFO: `/v3/projects/9c7d815df7c246e79d41bdf836c42cb6` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:14.169983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c7d815df7c246e79d41bdf836c42cb6)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:14.171403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3025438-337a-419e-b37d-dd54c1c39bb4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:14.173101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 577/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:14 2022] GET /identity/v3/projects/9c7d815df7c246e79d41bdf836c42cb6 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:14.179820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:14.271336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929acc-47e1-4853-ba73-568d622f741b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:14.302526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:14.303476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:14.303756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:14.304588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] PATH_INFO: `/v3/projects/9c7d815df7c246e79d41bdf836c42cb6/users/1d4959515cd940abac1712b4c287f539/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:14.306511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c7d815df7c246e79d41bdf836c42cb6, user_id=1d4959515cd940abac1712b4c287f539, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:14.307922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0e07e-a2a2-4437-ad83-a02e56aed3c7 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:14.321005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 576/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:36:14 2022] PUT /identity/v3/projects/9c7d815df7c246e79d41bdf836c42cb6/users/1d4959515cd940abac1712b4c287f539/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:36:16.525596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8491d-cbb8-42d1-9bc7-e610e9d2c2ca None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:16.526336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8491d-cbb8-42d1-9bc7-e610e9d2c2ca None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:16.526336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8491d-cbb8-42d1-9bc7-e610e9d2c2ca None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:16.528023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 578/1154] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:16.533790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:16.534498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:16.534776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:16.551711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:16.552912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:16.617149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 577/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:16.640432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8491d-cbb8-42d1-9bc7-e610e9d2c2ca None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:16.734968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8491d-cbb8-42d1-9bc7-e610e9d2c2ca None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:16.765888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:16.766650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:16.766930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:16.767202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:16.776742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:16.784110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:16.785296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:36:16.786597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 579/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:16.791201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:16.885343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74788-3eb0-478c-ba28-52520563fed4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:16.918447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:16.919103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:16.919391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:16.919670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:16.920439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:16.920749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:16.922106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:16.930080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 578/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:16.935755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:17.029286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a629e82-1ff4-404c-8a40-2ec97cee401d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:17.060740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:17.061588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:17.061874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:17.062150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] PATH_INFO: `/v3/users/1d4959515cd940abac1712b4c287f539` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:17.063309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] RBAC: Authorizing `identity:get_user(user_id=1d4959515cd940abac1712b4c287f539)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:17.064764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:17.066362 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 580/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:16 2022] GET /identity/v3/users/1d4959515cd940abac1712b4c287f539 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:17.072331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:17.165374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8dbcd-38d1-4fbc-893f-e517328e04e5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:17.197298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:17.197927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:17.198213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:17.198495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:17.261357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:17.262781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:17.354676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 579/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:17.360664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:17.452691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25b1-576c-4eed-b9eb-ac387fad646c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:17.483952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:17.484811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:17.485096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:17.485370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] PATH_INFO: `/v3/projects/9c7d815df7c246e79d41bdf836c42cb6` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:17.486522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] RBAC: Authorizing `identity:get_project(project_id=9c7d815df7c246e79d41bdf836c42cb6)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:17.487938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a98e86-b710-4aaf-886d-d9883b6a59eb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:17.489602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 581/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:17 2022] GET /identity/v3/projects/9c7d815df7c246e79d41bdf836c42cb6 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:17.495815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:17.589902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b4990-131c-4aba-bf6f-4e99e8587059 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:17.621840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:17.622426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:17.622711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:17.622990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:17.623815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=9c7d815df7c246e79d41bdf836c42cb6, user.id=1d4959515cd940abac1712b4c287f539) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:17.624128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:17.625596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746161d-508d-46ae-b917-9397ac1836ae None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:17.631135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 580/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:36:17 2022] GET /identity/v3/role_assignments?user.id=1d4959515cd940abac1712b4c287f539&scope.project.id=9c7d815df7c246e79d41bdf836c42cb6&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:19.855680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83881e-fa14-4ec8-8bee-507368f09f2c None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:19.856204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83881e-fa14-4ec8-8bee-507368f09f2c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:19.856331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83881e-fa14-4ec8-8bee-507368f09f2c None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:19.857632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 582/1162] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:19.862726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:19.863160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:19.863269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:19.879828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:19.881039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:19.943006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 581/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:19.965381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83881e-fa14-4ec8-8bee-507368f09f2c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:20.058644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83881e-fa14-4ec8-8bee-507368f09f2c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:20.089376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:20.089997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:20.090276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:20.090545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:20.151695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:20.153081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:20.242848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 583/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:20.248839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:20.343730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985a162-efd3-474e-bbaa-2bd5627b1774 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:20.374566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:20.375343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:20.375621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:20.375890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:20.383068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:20.384514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-aadcdc47-a01b-436f-9b20-4d2d04380e0b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:20.398623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:20.399876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:20.400970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 582/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:36:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:20.405775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:20.496475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0d47-29c3-41b6-ba68-e4a5b8f9eb0b None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:20.528440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:20.529063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:20.529340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:20.529607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:20.530319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:20.530622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:20.532001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcddb794-cafa-4ab8-99a5-00d23e3f21a0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:20.539884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 584/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue May 10 16:36:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:22.728171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6529c-2a19-4e49-a73e-7c6b741851d0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:22.728738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6529c-2a19-4e49-a73e-7c6b741851d0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:22.728738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6529c-2a19-4e49-a73e-7c6b741851d0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:22.730126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 583/1167] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:22.735313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2fb1-a15e-4383-a8c0-cb9deed5cf82 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:22.735749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2fb1-a15e-4383-a8c0-cb9deed5cf82 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:22.735880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f2fb1-a15e-4383-a8c0-cb9deed5cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:22.751841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-cb3f2fb1-a15e-4383-a8c0-cb9deed5cf82 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:22.753033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-cb3f2fb1-a15e-4383-a8c0-cb9deed5cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:22.814919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 585/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:22.838032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6529c-2a19-4e49-a73e-7c6b741851d0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:22.933672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6529c-2a19-4e49-a73e-7c6b741851d0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:22.964751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:22.965390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:22.965672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:22.965944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:22.966674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:22.968025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0b319-1cad-459d-9979-d8b90d010753 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:22.982305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 584/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue May 10 16:36:22 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:36:25.205896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a0ef-564f-4ecf-b501-e52e1f3c58fa None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:25.206454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a0ef-564f-4ecf-b501-e52e1f3c58fa None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:25.206454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9a0ef-564f-4ecf-b501-e52e1f3c58fa None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:25.207799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 586/1170] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:25.213739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:25.214139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:25.214304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:25.230968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:25.232142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:25.296629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 585/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:25.320352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a0ef-564f-4ecf-b501-e52e1f3c58fa None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:25.415278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9a0ef-564f-4ecf-b501-e52e1f3c58fa None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:25.446950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:25.447782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:25.448059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:25.448352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] PATH_INFO: `/v3/domains/bbdb7faa7233439fa6d48e44078e1025` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:25.457999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=bbdb7faa7233439fa6d48e44078e1025)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:25.459379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f4cf-60a3-4a13-a1d9-aacec75ad13f None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:25.461209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 587/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 10 16:36:25 2022] GET /identity/v3/domains/bbdb7faa7233439fa6d48e44078e1025 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:25.466970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:25.564190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000ab2a-5164-4b2f-95e8-da300a016f98 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:25.597935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:25.598590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:25.598875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:25.599155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:25.599865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:25.604669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec70f47-ea2e-46cc-8d76-01fa5559dd99 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:25.629226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 586/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:36:25 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:36:27.952542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43223b-135f-4bc2-adc8-8c89548b252b None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:27.953062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43223b-135f-4bc2-adc8-8c89548b252b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:27.953174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43223b-135f-4bc2-adc8-8c89548b252b None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:27.954459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 588/1174] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:27.960502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:27.960971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:27.961068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:27.977030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:27.978185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:28.040026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 587/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:28.064500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43223b-135f-4bc2-adc8-8c89548b252b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:28.160058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43223b-135f-4bc2-adc8-8c89548b252b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:28.192833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:28.193667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:28.194746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:28.195024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] PATH_INFO: `/v3/domains/bbdb7faa7233439fa6d48e44078e1025` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:28.196175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bbdb7faa7233439fa6d48e44078e1025)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:28.197619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfa49b-90d8-431f-b8d8-1eacc4763ad7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:28.199190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 589/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue May 10 16:36:28 2022] GET /identity/v3/domains/bbdb7faa7233439fa6d48e44078e1025 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:28.204881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:28.294457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4539-e38f-4766-b1cf-0c5e9614b892 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:28.326783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:28.327437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:28.327713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:28.327984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:28.328706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:28.330116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b675f6-f19a-4a5f-a92e-adc2562ced7f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:28.350467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 588/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:36:28 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:36:30.625124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314682b-066d-4080-952f-ea81f83c1c70 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:30.625579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314682b-066d-4080-952f-ea81f83c1c70 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:30.625704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314682b-066d-4080-952f-ea81f83c1c70 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:30.627034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 590/1178] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:30.633009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:30.633455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:30.633558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:30.650191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:30.651356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:30.713738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 589/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:30.736725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314682b-066d-4080-952f-ea81f83c1c70 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:30.831352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314682b-066d-4080-952f-ea81f83c1c70 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:30.862321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:30.863086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:30.863363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:30.863633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:30.873130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:30.880518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:30.882104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:36:30.882995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 591/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:30.888071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:30.979505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee2358-6aef-4ce7-a0b3-e495770c5564 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:31.010855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:31.011505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:31.011784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:31.012054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:31.012814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:31.013117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:31.014476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:31.022545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 590/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:31.028219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:31.122261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f807f7d-fd5f-4634-a3f0-f951f943fdab None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:31.154580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:31.155427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:31.155709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:31.155980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] PATH_INFO: `/v3/users/0820b12d5b884fab92c42b5f23c07f1d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:31.168268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] RBAC: Authorizing `identity:get_user(user_id=0820b12d5b884fab92c42b5f23c07f1d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:31.169729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:31.171347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 592/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:31 2022] GET /identity/v3/users/0820b12d5b884fab92c42b5f23c07f1d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:31.177217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:31.274561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2e05f-c5e4-448e-ad39-e40b91a8229b None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:31.306650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:31.307293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:31.307573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:31.307848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:31.375748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:31.377134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:31.477369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 591/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:31.483161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:31.577256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146fa25-a212-4e98-9c94-37faaff3f4ae None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:31.609053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:31.609896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:31.610178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:31.610454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] PATH_INFO: `/v3/projects/7762a0136ca74ef9a38e7983570afea3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:31.611597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=7762a0136ca74ef9a38e7983570afea3)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:31.613038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355504bf-fb67-41e7-99c7-32d879a7f4a2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:31.614700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 593/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:31 2022] GET /identity/v3/projects/7762a0136ca74ef9a38e7983570afea3 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:31.621183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:31.711674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f20329d-92cb-4e69-b01d-fd8cd9d3f9e5 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:31.743956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:31.744623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:31.744906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:31.745212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:31.746018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=7762a0136ca74ef9a38e7983570afea3, user.id=0820b12d5b884fab92c42b5f23c07f1d) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:31.746326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:31.747744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad9d68-9cb2-436e-85b0-3f8ab0a5ee9a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:31.752928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 592/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:36:31 2022] GET /identity/v3/role_assignments?user.id=0820b12d5b884fab92c42b5f23c07f1d&scope.project.id=7762a0136ca74ef9a38e7983570afea3&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:34.018585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441a63-d79d-4abd-927c-d2c376dd6dab None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.019149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441a63-d79d-4abd-927c-d2c376dd6dab None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.019149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441a63-d79d-4abd-927c-d2c376dd6dab None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.020588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 594/1186] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:34.027284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.027799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.027902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.045864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:34.047154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:34.109580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 593/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:34.133309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441a63-d79d-4abd-927c-d2c376dd6dab None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.227159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441a63-d79d-4abd-927c-d2c376dd6dab None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.259038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.259797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.260086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.260377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.269792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:34.277241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:34.278345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:36:34.279420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 595/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:36:34.284263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.378245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23334518-220a-47a0-a3b3-af51e467c0b7 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.410620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.411274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.411557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.411831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.413357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:34.413474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:34.414784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:34.426183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 594/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:34.432728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.525512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b9908-423f-46ce-9930-96b38a4ab04f None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.557749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.558603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.558886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.559160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] PATH_INFO: `/v3/users/0820b12d5b884fab92c42b5f23c07f1d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.560344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] RBAC: Authorizing `identity:get_user(user_id=0820b12d5b884fab92c42b5f23c07f1d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:34.561765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:34.563371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 596/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:34 2022] GET /identity/v3/users/0820b12d5b884fab92c42b5f23c07f1d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:34.569144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.669210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f03ed2-c332-42b7-b864-a85df47f668d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.701768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.702602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.702883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.703155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] PATH_INFO: `/v3/projects/7762a0136ca74ef9a38e7983570afea3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.704331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] RBAC: Authorizing `identity:get_project(project_id=7762a0136ca74ef9a38e7983570afea3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:34.705761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953eabe-f8c3-44cd-bb92-b8df4614e401 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:34.707436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 595/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:34 2022] GET /identity/v3/projects/7762a0136ca74ef9a38e7983570afea3 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:34.713451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:34.806339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e178e1-a07f-47cc-8956-edaa9722659c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:34.837054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:34.837917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:34.838194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:34.838463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] PATH_INFO: `/v3/projects/7762a0136ca74ef9a38e7983570afea3/users/0820b12d5b884fab92c42b5f23c07f1d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:34.840365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] RBAC: Authorizing `identity:create_grant(project_id=7762a0136ca74ef9a38e7983570afea3, user_id=0820b12d5b884fab92c42b5f23c07f1d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:34.841774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0ac9-a09f-4110-b16f-e6564518a031 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:34.853743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 597/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:36:34 2022] PUT /identity/v3/projects/7762a0136ca74ef9a38e7983570afea3/users/0820b12d5b884fab92c42b5f23c07f1d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:36:37.022521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec75c0-402c-471f-9f5f-14605a22dad8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.023116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec75c0-402c-471f-9f5f-14605a22dad8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.023116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec75c0-402c-471f-9f5f-14605a22dad8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.024474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 596/1193] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:36:37.029619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.030052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.030178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.046977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:36:37.048430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:36:37.110268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 598/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:36:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:36:37.133628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec75c0-402c-471f-9f5f-14605a22dad8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.228698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec75c0-402c-471f-9f5f-14605a22dad8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.259907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.260703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.260987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.261262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.272402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:36:37.280018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:36:37.281095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:36:37.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 597/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:36:37.286922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.377634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826d367-f400-4aa2-8e0e-a9d00ef003be None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.409314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.409955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.410238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.410510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.411235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:37.411538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:37.413152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:37.420629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 599/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:37.426476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.517859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7653f8-b6fb-48ec-a9ba-f64ac1df91b3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.549925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.550707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.550985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.551256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] PATH_INFO: `/v3/users/0820b12d5b884fab92c42b5f23c07f1d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.552434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] RBAC: Authorizing `identity:get_user(user_id=0820b12d5b884fab92c42b5f23c07f1d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:37.554059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:37.555652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 598/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/users/0820b12d5b884fab92c42b5f23c07f1d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:37.561303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.652993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f86f-921d-4def-826f-2ef36e125bc4 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.683197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.683820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.684097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.684404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.745200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:37.746626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:37.836252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 600/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:36:37.842005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:37.936466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf8fe-7f70-4ade-8d85-7e5840ce3b60 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:37.970575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:37.971413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:37.971688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:37.971953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] PATH_INFO: `/v3/projects/7762a0136ca74ef9a38e7983570afea3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:37.973136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] RBAC: Authorizing `identity:get_project(project_id=7762a0136ca74ef9a38e7983570afea3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:37.974540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf324b6-2e22-4827-9b1c-683c50595d7c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:37.976214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 599/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/projects/7762a0136ca74ef9a38e7983570afea3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:36:37.982253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:36:38.074817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e7434-faf5-4ba1-92c3-0faf8f3d40a7 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:36:38.106255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:36:38.106895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:36:38.107178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:36:38.107453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:36:38.108294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=7762a0136ca74ef9a38e7983570afea3, user.id=0820b12d5b884fab92c42b5f23c07f1d) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:36:38.108612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:36:38.110024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481452a-de5a-4f09-8c52-26be30f1da77 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:36:38.116097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 601/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:36:37 2022] GET /identity/v3/role_assignments?user.id=0820b12d5b884fab92c42b5f23c07f1d&scope.project.id=7762a0136ca74ef9a38e7983570afea3&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:39.014954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c945f8-c51c-4472-83e4-ddbc24d3bba7 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:39.015553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c945f8-c51c-4472-83e4-ddbc24d3bba7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:39.015553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c945f8-c51c-4472-83e4-ddbc24d3bba7 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:39.017081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 600/1201] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:39.024019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:39.024561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:39.024649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:39.046662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:39.046662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:39.141876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 602/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:37:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:37:39.171702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c945f8-c51c-4472-83e4-ddbc24d3bba7 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:39.306854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c945f8-c51c-4472-83e4-ddbc24d3bba7 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:39.347003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:39.348081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:39.348410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:39.348742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:39.360391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:39.361932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:39.383958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:39.385278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:39.386471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:39.386471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:39.386471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:39.386471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:39.386471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 601/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:39.392124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:39.520645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23feaff1-ba0d-4556-8e67-3c96f634ccf8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:39.567937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:39.568606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:39.568886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:39.569181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:39.569989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:39.570324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:39.572303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19eaaf-7631-4d15-9f7d-f4a295e89a75 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:39.585738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 603/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:39.591854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:39.711153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6756f-6a38-41cf-ad16-a3e94a8dc186 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:39.752213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:39.753263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:39.754463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:39.754777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:39.758282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:39.758282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6df1e-e722-4a01-8bc1-277d299359a3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:39.781920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 602/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue May 10 16:37:39 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:37:42.348699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a819ee-2932-4c13-87ed-c1e20b6ef921 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.349340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a819ee-2932-4c13-87ed-c1e20b6ef921 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.349340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a819ee-2932-4c13-87ed-c1e20b6ef921 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.351369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 604/1206] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:42.357614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.358018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.358232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.378037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:42.380522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:42.457901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 603/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:37:42.480891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a819ee-2932-4c13-87ed-c1e20b6ef921 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:42.608063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a819ee-2932-4c13-87ed-c1e20b6ef921 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:42.647981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:42.648806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.649090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.649361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.661016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:37:42.668973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:42.670192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:42.671327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 605/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:42.679246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:42.797947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656de827-067b-42df-b3ce-403f45bbf2f8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:42.837869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:42.838534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:42.838845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:42.839127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:42.839972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:42.840360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:42.841887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:42.850855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 604/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:42.856451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:42.968662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20ac65-c6c3-47e4-b6a7-1eb4869aaf24 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:43.016547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:43.020209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:43.020774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:43.021105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:43.037181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:43.038695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:43.057843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:43.058925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:43.059858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:43.059858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:43.059858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:43.059858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:43.059858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 606/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:43.065090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:43.173531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517e560-7e78-4577-aeb6-2a3fc5a5f4d9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:43.213563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:43.214708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:43.214708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:43.214987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:43.215821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:43.216148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:43.220865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:43.238461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 605/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:43.239933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:43.354416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b86a7-d2ed-41ee-8aeb-a3d38b08e776 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:43.392249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:43.393101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:43.393382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:43.393650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:43.404087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:43.406127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:37:43.423055 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:43.424338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:43.426488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:43.429291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 607/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:43.430126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:43.542870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3189e5e-cad3-4e2d-b641-a9597c2feb91 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:43.580697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:43.581523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:43.583072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:43.583072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:43.583411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:43.583720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:43.585138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:43.608252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 606/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:37:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:43.609555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:43.726850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cee830-4df8-464a-8d96-dd3334f30702 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:43.764382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:43.765611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:43.765902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:43.766171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:43.834254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:43.835995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:43.942650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 608/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:37:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:37:43.944133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.051665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca754c53-099e-4182-9f19-ae0cc8db7f6d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.086051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.086753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.087030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.087290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.099232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.100827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:44.122021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:44.123310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:44.124472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:44.124472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:44.124472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:44.124472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:44.128315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 607/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:37:44.129878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.231743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0f15-db1a-44b6-a157-1aed95e16b9c None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.269332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.270092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.270449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.270802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.271592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:44.271970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.273497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.285776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 609/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:44.291204 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.403138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd220b1-1139-4d37-a2f5-7811c42265d0 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.447756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.448591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.448904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.449230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.458402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.460031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:37:44.474519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:44.475704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:44.476938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:44.480605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 608/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:44.481448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.605880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18bc2-fa7d-4c0d-9505-3bcba4d1f88d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.642383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.643106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.643396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.643683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.645001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:44.645442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.647424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0d8b8-609d-46a8-8c6c-c83ac23e33e4 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.669260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 610/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:44.670922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:44.787077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814842d2-00eb-409c-8728-8d282bbeb0cc None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:44.833331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:44.833994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:44.834295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:44.834544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:44.835411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=bba8591023ac48f6af78ecb039dabb33) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:44.835712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:44.837150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b5808-44af-403d-a8ab-884e67bde202 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:44.843003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 609/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:37:44 2022] GET /identity/v3/role_assignments?user.id=bba8591023ac48f6af78ecb039dabb33&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:47.266316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bb8e-c194-40c8-9df4-ae145cb2e7ab None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.266869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bb8e-c194-40c8-9df4-ae145cb2e7ab None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.266964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bb8e-c194-40c8-9df4-ae145cb2e7ab None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.268336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 611/1220] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:47.275043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.275499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.275604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.294255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:47.295856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:47.369084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 610/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:37:47.393818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bb8e-c194-40c8-9df4-ae145cb2e7ab None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:47.493963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bb8e-c194-40c8-9df4-ae145cb2e7ab None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:47.529556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:47.530291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.530560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.530835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.541780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:37:47.552228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:47.553473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:47.554443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 612/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:47.560660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:47.670817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5fb36-8b98-4a16-85ed-d531c4c34192 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:47.708432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:47.709199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.709532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.709820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.710566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:47.710945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:47.712449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:47.721679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 611/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:47.728207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:47.833293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f5ffe-6695-4f14-a878-810ff32834f3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:47.869607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:47.870522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:47.870836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:47.871160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:47.882773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:47.884391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:47.903657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:47.904802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:47.905753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:47.905753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:47.905753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:47.905753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:47.905753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 613/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:47.911943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.017276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b6256-9752-4e9e-8d7d-140c461170a2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.056862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.057612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.057932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.058305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.059118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:48.059449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.060975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.073123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 612/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:48.078884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.183797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630ddb7-15eb-46f2-b12a-97ac1f7c86b0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.220526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.221320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.221596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.222372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] PATH_INFO: `/v3/users/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.229445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.230894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:37:48.245917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:48.247095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:48.248550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 614/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:48.253201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.360389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83abf36-821c-4301-b11b-0d4323203419 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.399515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.400180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.400496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.400771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.401600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:48.401909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.403321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.421040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 613/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:48.427166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.528994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3452199-3a12-4cd5-b24d-21cf6eba415d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.568158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.568981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.569322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.569541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.580327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.582448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:48.600948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:48.602033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:48.602927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:48.602927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:48.602927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:48.602927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:48.602927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 615/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:48.608010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.714228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724acd-fead-4ba6-b36d-12ff59ddd5e3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.749532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.750162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.750443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.750720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.751442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:48.751764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.753778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.765660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 614/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:48.773151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:48.882137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5115-af2a-4d85-9d44-0b96dceb979e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:48.917379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:48.918210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:48.918496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:48.918837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:48.926024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:48.927542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:37:48.941883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:48.943090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:48.944174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 616/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:48.948906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:49.050799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c20b-1507-4d80-826a-409c3686d167 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:49.084408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:49.085087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:49.085377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:49.085654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:49.086437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:49.086746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:49.088173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea3e6d-240b-4326-b0c4-d767c95f9104 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:49.099854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 615/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:49.106386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:49.213705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2695249-d3b4-4f60-9201-348a3f893fce None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:49.249841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:49.250717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:49.251002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:49.251276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/bba8591023ac48f6af78ecb039dabb33/roles/a03e54ac75064ad88ba9a9fe90623c60` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:49.266625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=bba8591023ac48f6af78ecb039dabb33, role_id=a03e54ac75064ad88ba9a9fe90623c60)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:49.268221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23073fc-af4b-481b-937a-d6392f954d4d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:49.281422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 617/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:37:49 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/bba8591023ac48f6af78ecb039dabb33/roles/a03e54ac75064ad88ba9a9fe90623c60 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:37:51.552712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8421f-711f-4f9b-a10f-c8df9cf1d2f8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:51.553263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8421f-711f-4f9b-a10f-c8df9cf1d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:51.553454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8421f-711f-4f9b-a10f-c8df9cf1d2f8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:51.554964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 616/1233] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:51.560919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:51.561399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:51.561519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:51.578714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:51.579933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:51.652328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 618/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:37:51.679171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8421f-711f-4f9b-a10f-c8df9cf1d2f8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:51.786063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8421f-711f-4f9b-a10f-c8df9cf1d2f8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:51.823530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:51.824313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:51.824600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:51.824881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:51.836424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:37:51.844543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:51.845799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:51.847293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 617/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue May 10 16:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:51.853264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:51.958111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd01fb-bc1b-4c2b-8235-b7782b5141f4 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:51.994954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:51.995702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:51.996005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:51.996359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:51.997187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] RBAC: Adding query filter params (name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:51.997586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:51.999298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.013344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 619/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue May 10 16:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:52.014938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.128330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b272e7e-0384-4504-ae04-a6c0672b807f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.162191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.162980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.163261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.163536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.173986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.176086 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:52.194599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:52.195587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:52.196573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:52.196573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:52.196573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:52.196573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:52.196573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 618/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:52.201736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.305389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369ccf-dddc-4423-a705-8bbf6ac5f4ca None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.345968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.346772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.347145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.347461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.348528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:52.348926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.350297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.364959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 620/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:52.371060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.484009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975417-8e0f-4f20-a773-fc73cd0fbe1f None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.517454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.518256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.518603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.518976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.526932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.528431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:37:52.547828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:52.549082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:52.550692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 619/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:52.556049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.668141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5046-6431-49f2-baa0-d4ea90432778 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.704894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.705634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.705923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.706416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.707301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:52.707609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.709068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:52.729223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 621/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:52.735195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:52.842460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607be2c-20a4-418c-a8e8-64fee52c909c None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:52.882584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:52.883323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:52.883650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:52.883984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:52.954912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:52.957345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.072956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 620/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:37:53.079810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:53.194633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a977b-2c1a-468a-af5b-07c728f9a353 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:53.229689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:53.230669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.230957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.231471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.245591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:53.247065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:53.269843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:53.271079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:53.272117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:53.272117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:53.272117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:53.272117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:53.272117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 622/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:53.277849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:53.406459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040849a-1861-4e19-8f13-cfcf29672f2a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:53.443919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:53.444726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.445039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.445343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.446062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:53.446402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:53.447992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.460307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 621/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:37:53.466029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:53.582889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e3a77-3254-4790-b10a-25cda659b7a3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:53.623334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:53.624129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.624445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.624722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.632075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:53.633857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:37:53.650031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:53.651138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:53.652053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 623/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:53.657340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:53.761581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb74b2b-7cf5-44cb-809a-495dee44d7f2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:53.795043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:53.795753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.796039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.796343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.797377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:53.797696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:53.799116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba7b3-39b5-4e18-9515-04c49c3f8d5b None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.811210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 622/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:53.817154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:53.924140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc951b1-b203-459d-8365-fde00616778d None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:53.961316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:53.962060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:53.962402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:53.962662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:53.963676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] RBAC: Adding query filter params (role.id=a03e54ac75064ad88ba9a9fe90623c60, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=bba8591023ac48f6af78ecb039dabb33) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:53.964011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:53.965865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f43e-785b-4111-9a8d-d2ebe719590d None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:53.977509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 624/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:37:53 2022] GET /identity/v3/role_assignments?user.id=bba8591023ac48f6af78ecb039dabb33&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=a03e54ac75064ad88ba9a9fe90623c60 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:56.486183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440b8b4-b209-44a0-9b43-0877146d5949 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.486751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440b8b4-b209-44a0-9b43-0877146d5949 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.486751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440b8b4-b209-44a0-9b43-0877146d5949 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.488774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 623/1247] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:37:56.494824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.495335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.495335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.512475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:37:56.513651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:37:56.589070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 625/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:37:56.613682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440b8b4-b209-44a0-9b43-0877146d5949 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:56.719975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440b8b4-b209-44a0-9b43-0877146d5949 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:56.755152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:56.755903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.756154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.756476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.771119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:37:56.778988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:56.780318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:56.782162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 624/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:56.789621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:56.908745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b89193-6c31-4cd3-835f-a5993418c161 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:56.947975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:56.948923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:56.949282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:56.949728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:56.950680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:56.951235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:56.953060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:56.964935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 626/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:56.972473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.086540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5b05d-26fe-4d7d-a21d-10f2bdb996b2 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.121932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.122754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.123055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.123315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.134016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.135672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:57.155992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:57.157131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:57.158185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:57.158185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:57.158185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:57.158185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:57.158185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 625/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:57.164260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.266339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7fa07-9fc0-4b09-811c-bfd293cd7bc9 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.299479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.300699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.300980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.301248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.301961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:57.302261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.303612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:57.315448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 627/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:57.321540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.432084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be4c4-d276-4896-97aa-cf184a13e429 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.467318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.468199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.468515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.468793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.477457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.478888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:37:57.495056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:57.496777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:37:57.497973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 626/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:57.503897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.624583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda2ad-2497-4dc1-80c3-e7621d78f263 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.661623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.662282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.662561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.662830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.663664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:57.663969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.665426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:57.688345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 628/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:37:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:57.691535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:57.801987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e3415-0abb-4c7d-97b7-0df4454c36c3 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:57.838132 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:57.838802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:57.839087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:57.839364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:57.908834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:57.910839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.012030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 627/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:37:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:37:58.018032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:58.119036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b30c-53b8-46e7-a224-aeb87f9c7a07 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:58.153540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:58.154338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:58.154619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:58.154891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:58.165710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:58.167160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:37:58.184938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:58.186037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:58.187152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:37:58.187152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:37:58.187152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:37:58.187152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:58.187152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 629/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:58.193156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:58.290912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aa1a-e041-4e0c-b4e1-fd27fac04eb8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:58.324976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:58.325645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:58.325926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:58.326205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:58.326928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:58.327237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:58.328630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.339919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 628/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:58.345675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:58.445002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d34249-3321-4142-a839-f3d22d4a5ad3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:58.477000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:58.477780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:58.478060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:58.478329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:58.484664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:58.486094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:37:58.499963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:37:58.501043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:37:58.502154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 630/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:37:58.507049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:58.609383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae98-a0f5-4737-b8cd-c4df5e1abb9d None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:58.640865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:58.641508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:58.641787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:58.642061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:58.642835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:58.643139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:58.644680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09093e93-852a-4b6e-af91-e0736201088d None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.655822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 629/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:37:58.662612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:37:58.757716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9181-66e3-4b59-b9e8-63ba0bf07c1e None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:37:58.793159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:37:58.793802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:37:58.794081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:37:58.794352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:37:58.795163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=bba8591023ac48f6af78ecb039dabb33) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:37:58.795468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:37:58.796912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19ca7f-348f-4ab0-956c-3470fe2321ee None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:37:58.802390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 631/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:37:58 2022] GET /identity/v3/role_assignments?user.id=bba8591023ac48f6af78ecb039dabb33&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:00.986375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7977fc-88b5-40c7-8ebf-ce9064505728 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:00.986971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7977fc-88b5-40c7-8ebf-ce9064505728 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:00.986971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7977fc-88b5-40c7-8ebf-ce9064505728 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:00.988882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 630/1261] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:00.994123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:00.994496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:00.994676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.011018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:01.012182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:01.075371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 632/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:01.099447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7977fc-88b5-40c7-8ebf-ce9064505728 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.196102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7977fc-88b5-40c7-8ebf-ce9064505728 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.228109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.228914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.229197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.229471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.239102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:38:01.246568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:01.247698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:01.248821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 631/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 16:38:01.253659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.344650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd15d31-c560-4c7c-bbe4-2b39a881abf6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.376924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.378178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.378178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.378711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.379413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:01.379712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:01.381091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:01.388759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 633/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:01.395236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.488068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28c2b2-c8cb-4f88-a32a-15db4887f55a None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.519578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.520304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.520589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.520858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.530647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:01.532090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:38:01.549467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:01.556226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:01.557557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:38:01.557557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:38:01.557557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:01.557557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:01.557557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 632/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:01.557916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.660127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf6f3-5a7e-4dd0-bdf1-3fa717f7396a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.691424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.692067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.692382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.692664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.693379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:01.693689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:01.695060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:01.706631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 634/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:01.712399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.806620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858ba20-d5d3-4777-8ad1-134599d721ae None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.837357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.838131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.838411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.838685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.845643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:01.847082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:38:01.860737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:01.862354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:01.863554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 633/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:01.868209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:01.960499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c1b41-aeae-4e6c-b9b0-224f0c10bbd1 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:01.991908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:01.992588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:01.992873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:01.993150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:01.993981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:01.994291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:01.995709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.012157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 635/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:38:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:02.017693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:02.110367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a4d5-7fa5-47f1-bd27-d1f90a7da395 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:02.142282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:02.143106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:02.143382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:02.143658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:02.153518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:02.154948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:38:02.171571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:02.172943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:02.174070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:38:02.174070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:38:02.174070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:02.174070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:02.174070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 634/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:02.179208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:02.271514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87589-7dc1-4760-8db4-7b83bca3d7d3 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:02.303984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:02.304650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:02.304934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:02.305209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:02.305925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:02.306232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:02.307581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.318260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 636/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:02.323785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:02.417293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550047de-c81b-4277-a9b6-f313e5049051 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:02.449344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:02.450116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:02.450397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:02.450671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:02.457097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:02.458518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:38:02.472616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:02.473659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:02.474780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 635/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:02.479469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:02.578482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933f3c7-9b70-4d66-ac6a-1d170e63343a None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:02.610237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:02.610875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:02.611158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:02.611428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:02.612266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:02.612625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:02.614047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f211-94e0-41a0-950e-bc86ffaf49b0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.625250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 637/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:02.631483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:02.724942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523c376-e2ce-4a5e-b6a5-0343f9d726e8 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:02.755951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:02.756838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:02.757119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:02.757390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] PATH_INFO: `/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/bba8591023ac48f6af78ecb039dabb33/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:02.759267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ac1e53e7a49aca2621d3bb9538fe4, user_id=bba8591023ac48f6af78ecb039dabb33, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:02.760705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71236d8-6b5d-40ae-8316-2838e3898e05 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:02.773460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 636/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue May 10 16:38:02 2022] PUT /identity/v3/projects/348ac1e53e7a49aca2621d3bb9538fe4/users/bba8591023ac48f6af78ecb039dabb33/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:38:04.949238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5ba1-4fd9-4c18-91f4-5d0785310ed8 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:04.949829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5ba1-4fd9-4c18-91f4-5d0785310ed8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:04.949829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc5ba1-4fd9-4c18-91f4-5d0785310ed8 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:04.951141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 638/1274] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:04.956348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:04.956724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:04.956902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:04.972890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:04.974053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:05.036208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 637/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:05.059795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc5ba1-4fd9-4c18-91f4-5d0785310ed8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.154082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc5ba1-4fd9-4c18-91f4-5d0785310ed8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.185700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.186466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.186751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.187027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.197168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 16:38:05.204729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:05.206406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:05.207437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 639/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:05.212455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.303851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5031c28-0406-4a3c-bfe8-4aec59eb1754 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.335910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.336589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.336869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.337142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.337877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:05.338180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:05.339533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:05.347621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 638/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:05.353361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.445162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4152936-2672-4b95-ae2e-e6b176ffa748 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.475964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.476706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.476985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.477256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.487775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:05.489231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:38:05.505382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:05.506407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:05.507656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:38:05.507656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:38:05.507656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:05.507656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:05.507656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 640/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:05.512113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.611436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bf82f-1253-48e9-a362-882331e74221 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.643724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.644476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.644757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.645027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.645738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:05.646039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:05.647396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:05.658595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 639/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:38:05.664724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.756769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560df54e-a382-44b7-85ab-2c3bbe1b7807 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.788262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.789071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.789389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.789668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.799259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:05.800779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 16:38:05.815023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:05.816124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:05.817379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 641/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:05.822726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:05.915145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baf766-169b-4a44-9d2d-e9a83f2510d9 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:05.946645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:05.947293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:05.947572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:05.947843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:05.948696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:05.948999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:05.950408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:05.966765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 640/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:05.972634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:06.067256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b90f5-2769-44ba-b6ba-a73bf34e37e6 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:06.098852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:06.099481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:06.099766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:06.100042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:06.168668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:06.170133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:06.263378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 642/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue May 10 16:38:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 16:38:06.269873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:06.362443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1f1c6-075c-4e75-b3d3-671071b0ab83 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:06.395171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:06.395942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:06.396225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:06.396530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:06.405926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:06.407354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 16:38:06.425242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:06.426355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:06.427496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 16:38:06.427496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 16:38:06.427496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 16:38:06.427496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:06.427496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 641/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:06.432074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:06.536536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e5db3-1bf4-4226-8ae2-fc137fd21bd2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:06.573073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:06.573732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:06.574018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:06.574294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:06.575011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:06.575319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:06.576732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:06.588096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 643/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue May 10 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:06.593795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:06.687392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314f664-e862-44e0-b3ce-fc01230cb318 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:06.719057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:06.719828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:06.720107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:06.720421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:06.727181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:06.728611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 16:38:06.742290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application with Lock( May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:06.743317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: ERROR keystone.server.flask.application May 10 16:38:06.744451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 642/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue May 10 16:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:06.749298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:06.850525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a0e47-d8ad-47c4-8c88-d523907eafcc None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:06.886297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:06.887431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:06.887948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:06.888528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:06.890037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:06.890613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:06.893365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734542d-b3be-4590-9d53-618b37b8a0da None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:06.905532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 644/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue May 10 16:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:06.912178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:07.006346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398beeb-cb5d-4cdb-8aef-fa4353889f77 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:07.037894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:07.038535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:07.038816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:07.039092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:07.039913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] RBAC: Adding query filter params (role.id=1b495dbb303447258ed6e7db6e67280f, scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4, user.id=bba8591023ac48f6af78ecb039dabb33) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:07.040227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:07.041666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025d03e-925e-409c-892f-e4de23830b78 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:07.047426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 643/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue May 10 16:38:06 2022] GET /identity/v3/role_assignments?user.id=bba8591023ac48f6af78ecb039dabb33&scope.project.id=348ac1e53e7a49aca2621d3bb9538fe4&role.id=1b495dbb303447258ed6e7db6e67280f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:09.257210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b2f-e0ee-4c30-9799-b5a5866de5fe None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:09.257784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b2f-e0ee-4c30-9799-b5a5866de5fe None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:09.257784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b2f-e0ee-4c30-9799-b5a5866de5fe None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:09.259140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 645/1288] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:09.264173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:09.264558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:09.264753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:09.281499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:09.282680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:09.345739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 644/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:09.367582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97b2f-e0ee-4c30-9799-b5a5866de5fe None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:09.462257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97b2f-e0ee-4c30-9799-b5a5866de5fe None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:09.493523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:09.494296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:09.494578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:09.494848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:09.495482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:09.496864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:09.508614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:09.509776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:09.510637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 646/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:38:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:09.515631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:09.625386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825bf1a-fae0-49a2-806a-6b86ac6df034 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:09.658287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:09.658967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:09.659249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:09.659527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:09.660224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:09.660558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:09.661917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527612b-aa4a-4b57-9c7d-a07642d1d3ba None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:09.666564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 645/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 10 16:38:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:09.672501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:09.765731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bccb2-5740-4bcd-a122-dacd6c8952f2 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:09.800166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:09.800837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:09.801124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:09.801400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] PATH_INFO: `/v3/services` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:09.802103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] RBAC: Adding query filter params (type=placement) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:09.802407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:09.803764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde52d5c-becd-4a68-82c3-c503f2f6fa6c None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:09.808022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 647/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 10 16:38:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:12.002761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05c6f-6e6e-4666-8366-1413fc5b3238 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:12.003317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05c6f-6e6e-4666-8366-1413fc5b3238 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:12.003317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f05c6f-6e6e-4666-8366-1413fc5b3238 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:12.004757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 646/1293] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:12.009914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cf225-ac14-4a6d-9924-81bd3b041627 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:12.010331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cf225-ac14-4a6d-9924-81bd3b041627 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:12.010468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cf225-ac14-4a6d-9924-81bd3b041627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:12.026893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ff0cf225-ac14-4a6d-9924-81bd3b041627 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:12.028067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ff0cf225-ac14-4a6d-9924-81bd3b041627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:12.089859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 648/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:12.113153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f05c6f-6e6e-4666-8366-1413fc5b3238 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:12.210952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f05c6f-6e6e-4666-8366-1413fc5b3238 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:12.243072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:12.243724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:12.244007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:12.244296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:12.245021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:12.246380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a38e3-6dca-4264-929b-9037e23c9b0a None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:12.259220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 647/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue May 10 16:38:12 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:38:14.541172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289f8-c225-4949-8466-dccbad011be0 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:14.541875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289f8-c225-4949-8466-dccbad011be0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:14.541875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289f8-c225-4949-8466-dccbad011be0 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:14.543081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 649/1296] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:14.550068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:14.550538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:14.550662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:14.567646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:14.568897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:14.638259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 648/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:14.661872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631289f8-c225-4949-8466-dccbad011be0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:14.755676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631289f8-c225-4949-8466-dccbad011be0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:14.787137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:14.787911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:14.788200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:14.788509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:14.789161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:14.790522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:14.802566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:14.803717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:14.804804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 650/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:38:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:14.809723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:14.901318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e48deb-ba7a-4374-9e37-0cfb66978357 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:14.934127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:14.934773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:14.935052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:14.935325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:14.936017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:14.936341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:14.937688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:14.943274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 649/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 10 16:38:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:14.949230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:15.046134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842863e3-7324-4a9f-b2e3-969e602329b0 None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:15.078036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:15.078618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:15.078900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:15.079172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:15.079947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] RBAC: Adding query filter params (interface=public, service_id=f52c4306d1b8429887a7ec05dfa7da87, region_id=RegionOne) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:15.080492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:15.081847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11cf5-9443-4bfb-8071-7350505d5fda None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:15.086594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 651/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue May 10 16:38:14 2022] GET /identity/v3/endpoints?service_id=f52c4306d1b8429887a7ec05dfa7da87&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:15.092125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:15.185015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c5b4-5a69-4fb8-a799-d77c0e60f364 None admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:15.216634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:15.217266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:15.217542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:15.217812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:15.218484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:15.219819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06ccf-6deb-4b57-9832-f3e62b336d7e None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:15.226433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 650/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue May 10 16:38:15 2022] GET /identity/v3/services => generated 2191 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:38:17.406753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddbe0-6eec-4634-85f7-64e0835d26c1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:17.407313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddbe0-6eec-4634-85f7-64e0835d26c1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:17.407313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddbe0-6eec-4634-85f7-64e0835d26c1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:17.408846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 652/1302] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:38:17.414054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:17.414426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:17.414618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:17.431965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:38:17.433169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:38:17.496737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 651/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:38:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 16:38:17.520902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ddbe0-6eec-4634-85f7-64e0835d26c1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:17.619961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ddbe0-6eec-4634-85f7-64e0835d26c1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:17.658000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:17.659323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:17.659602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:17.659876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] PATH_INFO: `/v3/services/placement` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:17.660562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:17.661943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 16:38:17.673713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 16:38:17.675700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.get_or_create( May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application with Lock( May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self._enter() May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application return self.creator() May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application created_value = creator( May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: ERROR keystone.server.flask.application May 10 16:38:17.676989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 653/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue May 10 16:38:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 16:38:17.681422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:17.772495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ea70-bf79-4cb9-b116-90fe910bb3be None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:17.804856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:17.805502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:17.805784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:17.806059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] PATH_INFO: `/v3/services` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:17.806755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:38:17.807062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:17.808440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a41652-ff97-44a9-8052-284a69f2db51 None admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:17.813330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 652/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue May 10 16:38:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:38:17.819005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:38:17.915552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a8a-1f16-4aa4-9992-cc2756546beb None admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:38:17.946825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:38:17.947467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:38:17.947749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:38:17.948023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:38:17.948788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:38:17.950154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df59c2a-8153-4f51-85a3-7e02589d3197 None admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:38:17.967896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 654/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue May 10 16:38:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:39:22.052996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdd60e-4b8c-41bc-9ebf-2893c076e3c7 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:22.053579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdd60e-4b8c-41bc-9ebf-2893c076e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:22.053579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdd60e-4b8c-41bc-9ebf-2893c076e3c7 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:22.054896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 653/1307] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:22.060193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacfe2-c73c-46ae-a7d8-a2e9905eb468 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:22.060687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacfe2-c73c-46ae-a7d8-a2e9905eb468 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:22.060768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacfe2-c73c-46ae-a7d8-a2e9905eb468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:22.136443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a2cacfe2-c73c-46ae-a7d8-a2e9905eb468 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:22.137869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a2cacfe2-c73c-46ae-a7d8-a2e9905eb468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:22.357874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 655/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:22.410480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a868c-1892-413c-a597-1c1772387de0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:22.410836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a868c-1892-413c-a597-1c1772387de0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:22.411118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a868c-1892-413c-a597-1c1772387de0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:22.412753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 654/1309] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 10 16:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:22.430784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376786c-4b24-426a-b50e-0757843c3553 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:22.430784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376786c-4b24-426a-b50e-0757843c3553 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:22.430784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376786c-4b24-426a-b50e-0757843c3553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:22.531620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-7376786c-4b24-426a-b50e-0757843c3553 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:22.534017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7376786c-4b24-426a-b50e-0757843c3553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:22.621354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 656/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 10 16:39:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:39:22.630571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a868c-1892-413c-a597-1c1772387de0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:22.632689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-303a868c-1892-413c-a597-1c1772387de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:22.766742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a868c-1892-413c-a597-1c1772387de0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:22.844931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:22.846393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:22.846827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:22.847260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:22.849199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:22.966104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:22.967841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81689c-6c97-4a55-869a-e4f11d45bfe2 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:22.989696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 655/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:25.623516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:25.624116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:25.624116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:25.625663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 657/1312] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:25.631943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f90d-0514-4f07-bf77-74a5e89c7c0e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:25.633022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f90d-0514-4f07-bf77-74a5e89c7c0e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:25.633742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981f90d-0514-4f07-bf77-74a5e89c7c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:25.730992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4981f90d-0514-4f07-bf77-74a5e89c7c0e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:25.732184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4981f90d-0514-4f07-bf77-74a5e89c7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:25.832321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 656/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:39:25.869596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:25.871193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:25.973475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391c7d8-05f3-4872-9575-79b377a36886 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:26.043234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:26.044047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:26.044368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:26.044645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:26.046512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:26.151040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:26.152415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bedd46-d048-437d-987c-45a8318863fc service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:26.170019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 658/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:28.722891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:28.723469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:28.723469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:28.724850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 657/1315] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:28.730133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0c45-ff36-4ffb-93fe-a650e3069561 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:28.730532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0c45-ff36-4ffb-93fe-a650e3069561 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:28.730695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d0c45-ff36-4ffb-93fe-a650e3069561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:28.793234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1f6d0c45-ff36-4ffb-93fe-a650e3069561 None None] MFA Rules not processed for user `a7bb3edff26f4939966d2db53dd69061`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:28.794422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1f6d0c45-ff36-4ffb-93fe-a650e3069561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:28.885397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 659/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:28.925096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:28.926600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:29.023760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3371-e1ef-4ecb-b8cc-51990c2ac027 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:29.094514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:29.095815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:29.096101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:29.096410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:29.098017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:29.202929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:29.204833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed879a21-269f-4ccf-b731-f42429d612bc service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:29.222694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 658/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:32.063742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.072016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.072016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.072016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 660/1318] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:32.073015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8dc1-b0f3-444c-ad7c-9f90297ab98d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.073435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8dc1-b0f3-444c-ad7c-9f90297ab98d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.073603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b8dc1-b0f3-444c-ad7c-9f90297ab98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.136562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-aa1b8dc1-b0f3-444c-ad7c-9f90297ab98d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:32.137757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-aa1b8dc1-b0f3-444c-ad7c-9f90297ab98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:32.233180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 659/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:32.272640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:32.274134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:32.372998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4cd62-dafa-4c40-9ea1-cff5584d463f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:32.442638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:32.443312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:32.443594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:32.443866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:32.445527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:32.550519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:32.551967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a525b5-713e-48c9-ba66-2533ad19583e service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:32.570685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 661/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:35.440736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:35.441300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:35.441300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:35.442642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 660/1321] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:35.447897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11368-71fc-473d-9620-ddb5c8273409 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:35.448363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11368-71fc-473d-9620-ddb5c8273409 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:35.448467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca11368-71fc-473d-9620-ddb5c8273409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:35.510069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-aca11368-71fc-473d-9620-ddb5c8273409 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:35.511247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-aca11368-71fc-473d-9620-ddb5c8273409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:35.606558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 662/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:35.641904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:35.643464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:35.742663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28929d17-2559-4a7c-b5b5-ff777c47612f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:35.813237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:35.814416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:35.814886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:35.815047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:35.816701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:35.922272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:35.924337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e4c78-1a00-41a4-9f6a-0c61fc58aa62 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:35.943846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 661/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:38.223063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:38.223646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:38.223646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:38.225010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 663/1324] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:38.230331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ab61-6c82-4734-b8e1-027d9d274e1e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:38.230759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ab61-6c82-4734-b8e1-027d9d274e1e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:38.230864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ab61-6c82-4734-b8e1-027d9d274e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:38.294971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d769ab61-6c82-4734-b8e1-027d9d274e1e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:38.295691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d769ab61-6c82-4734-b8e1-027d9d274e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:38.389935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 662/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:38.425874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:38.427366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:38.528191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1c20f-a524-47d9-be18-85df874293c5 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:38.602014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:38.602656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:38.602933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:38.603199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:38.604830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:38.713718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:38.715140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d4bb5-890d-4ba3-9106-91ae22cd3167 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:38.732610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 664/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:41.027071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813c09-4c17-453f-b975-98706c0c8988 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:41.027657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813c09-4c17-453f-b975-98706c0c8988 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:41.027657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813c09-4c17-453f-b975-98706c0c8988 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:41.029065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 663/1327] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:41.035039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ba4e-7eb4-4ef4-a472-456960c152c6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:41.035447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ba4e-7eb4-4ef4-a472-456960c152c6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:41.035595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601ba4e-7eb4-4ef4-a472-456960c152c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:41.099691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c601ba4e-7eb4-4ef4-a472-456960c152c6 None None] MFA Rules not processed for user `a7bb3edff26f4939966d2db53dd69061`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:41.100916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c601ba4e-7eb4-4ef4-a472-456960c152c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:41.194660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 665/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:41.247341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:41.247630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:41.247910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:41.249311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 664/1329] 10.222.0.48 () {54 vars in 964 bytes} [Tue May 10 16:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:39:41.256245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4e7e5-5cc4-4458-ba3d-0ba7f8baca33 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:41.256580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4e7e5-5cc4-4458-ba3d-0ba7f8baca33 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:41.256863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4e7e5-5cc4-4458-ba3d-0ba7f8baca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:41.346403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c0f4e7e5-5cc4-4458-ba3d-0ba7f8baca33 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:41.347517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c0f4e7e5-5cc4-4458-ba3d-0ba7f8baca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:41.422630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 666/1330] 10.222.0.48 () {58 vars in 1061 bytes} [Tue May 10 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:41.431816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:41.433373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:41.540542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca323e0-99a9-417b-b171-b7e17008dbe8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:41.616617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:41.617279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:41.617566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:41.617842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:41.619538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:41.724562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:41.726012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1474ff-5d1f-4c2e-83b7-b13781b724e0 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:41.743323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 665/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:44.621091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:44.621577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:44.621659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:44.623175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 667/1332] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:44.629836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14424e-507c-4ca5-943c-0768d25711c4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:44.630292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14424e-507c-4ca5-943c-0768d25711c4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:44.630520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14424e-507c-4ca5-943c-0768d25711c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:44.706901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-aa14424e-507c-4ca5-943c-0768d25711c4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:44.708107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-aa14424e-507c-4ca5-943c-0768d25711c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:44.805301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 666/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:44.841875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:44.843387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:44.946400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80cb7a-51af-4da9-b8d6-f9fd2003ae81 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:45.015429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:45.016074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:45.016390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:45.016665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:45.018885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:45.124523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:45.125965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26671a08-1f63-487f-8dea-4ccbea50cd56 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:45.144574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 668/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:47.413253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:47.413789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:47.413789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:47.415181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 667/1335] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:47.420442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b2ff-d80f-434a-8c04-aaa4665ea801 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:47.420886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b2ff-d80f-434a-8c04-aaa4665ea801 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:47.420983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7b2ff-d80f-434a-8c04-aaa4665ea801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:47.483644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4fa7b2ff-d80f-434a-8c04-aaa4665ea801 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:47.484859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4fa7b2ff-d80f-434a-8c04-aaa4665ea801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:47.578860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 669/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:47.618990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:47.620508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:47.719041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297b30b-0d52-47e6-9b82-84b45bb9fd07 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:47.788980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:47.789616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:47.789898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:47.790168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:47.791758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:47.893837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:47.895255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9145-ea0c-44a7-8f37-7d5ae3912ad4 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:47.912705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 668/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:50.443556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:50.444084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:50.444084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:50.445498 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 670/1338] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:50.450590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6e78-e74e-44f4-852b-ec92651565d4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:50.450981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6e78-e74e-44f4-852b-ec92651565d4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:50.451147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6e78-e74e-44f4-852b-ec92651565d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:50.513708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7acb6e78-e74e-44f4-852b-ec92651565d4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:50.514902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7acb6e78-e74e-44f4-852b-ec92651565d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:50.610957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 669/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:50.646542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:50.648033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:50.746475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba9f2-336b-45a3-b58a-c596ebedb5e5 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:50.816491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:50.817129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:50.817409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:50.817675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:50.819278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:50.922746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:50.925207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c328b-5b46-4307-92aa-f9f484f7b466 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:50.943265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 671/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:55.293535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:55.294064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:55.294064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:55.295367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 670/1341] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:55.301723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd23d5-c76c-41c7-9517-cc5a40c0e4eb None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:55.302165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd23d5-c76c-41c7-9517-cc5a40c0e4eb None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:55.302421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd23d5-c76c-41c7-9517-cc5a40c0e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:55.383545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-effd23d5-c76c-41c7-9517-cc5a40c0e4eb None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:55.384766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-effd23d5-c76c-41c7-9517-cc5a40c0e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:55.517336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 672/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:55.560509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:55.563165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:55.709005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea8a75-6daf-4e35-842a-4fca246d5399 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:55.712488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:55.713137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:55.713417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:55.713687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:55.723768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:55.725229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b01c15-864d-4fb9-bcd3-959b4835860a service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:55.734874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 671/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:39:58.766575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:58.767743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:58.767850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:58.769219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 673/1344] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:39:58.774358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1602fc-6830-4b92-88b2-70bd35db2e7f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:58.774832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1602fc-6830-4b92-88b2-70bd35db2e7f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:58.774938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1602fc-6830-4b92-88b2-70bd35db2e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:58.802151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fe1602fc-6830-4b92-88b2-70bd35db2e7f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:39:58.803336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fe1602fc-6830-4b92-88b2-70bd35db2e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:58.880409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 672/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:39:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:39:58.918027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:39:58.919843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:39:58.932846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f7fd-ce9e-4572-91fe-253543ed021e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:39:58.936250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:39:58.936898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:39:58.937182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:39:58.937453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:39:58.946776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:39:58.948202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff5e9-a2df-42bc-b78c-b55a9ffe573e service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:39:58.958020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 674/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:39:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:03.852808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a833-3d25-4246-8db3-ca87eca20514 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:03.853319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a833-3d25-4246-8db3-ca87eca20514 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:03.853319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a833-3d25-4246-8db3-ca87eca20514 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:03.854667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 673/1347] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:03.859959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d0ea-aa7e-48c4-a2d4-b4a4c83bdb84 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:03.860516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d0ea-aa7e-48c4-a2d4-b4a4c83bdb84 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:03.860516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760d0ea-aa7e-48c4-a2d4-b4a4c83bdb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:03.878999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b760d0ea-aa7e-48c4-a2d4-b4a4c83bdb84 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:03.880179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b760d0ea-aa7e-48c4-a2d4-b4a4c83bdb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:03.888141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 675/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:03.926991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a833-3d25-4246-8db3-ca87eca20514 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:03.937413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a833-3d25-4246-8db3-ca87eca20514 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:03.941000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:03.941698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:03.941985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:03.942258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:03.951098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:03.952553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1605133-c8ce-4fe9-9bdf-b2d5db91fdee service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:03.962437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 674/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:09.604671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456755a-6e85-4273-908b-19f494d783de None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:09.606053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456755a-6e85-4273-908b-19f494d783de None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:09.606797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456755a-6e85-4273-908b-19f494d783de None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:09.609846 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 676/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:09.618047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf85b-d680-4217-80cf-0cb6a1a6d821 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:09.618674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf85b-d680-4217-80cf-0cb6a1a6d821 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:09.618935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf85b-d680-4217-80cf-0cb6a1a6d821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:09.745976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3bbbf85b-d680-4217-80cf-0cb6a1a6d821 None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:09.748380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3bbbf85b-d680-4217-80cf-0cb6a1a6d821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:09.897804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 675/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:40:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:14.390486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea6e-4af6-445c-8dee-793c3f373e0e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:14.391012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea6e-4af6-445c-8dee-793c3f373e0e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:14.391109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfea6e-4af6-445c-8dee-793c3f373e0e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:14.393170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 677/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:14.398293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011367b-a657-4262-83cb-9e5e4ca0847e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:14.398783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011367b-a657-4262-83cb-9e5e4ca0847e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:14.399139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011367b-a657-4262-83cb-9e5e4ca0847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:14.418473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f011367b-a657-4262-83cb-9e5e4ca0847e None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:14.419675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f011367b-a657-4262-83cb-9e5e4ca0847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:14.429767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 676/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:40:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:16.065268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a290f-4c31-4053-94e3-5e9e960fff4d None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:16.065834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a290f-4c31-4053-94e3-5e9e960fff4d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:16.065834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a290f-4c31-4053-94e3-5e9e960fff4d None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:16.067177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 678/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:16.072539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570dc8-d8a6-4e3f-8b73-d21cddff60db None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:16.072940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570dc8-d8a6-4e3f-8b73-d21cddff60db None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:16.073186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5570dc8-d8a6-4e3f-8b73-d21cddff60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:16.092351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c5570dc8-d8a6-4e3f-8b73-d21cddff60db None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:16.093545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5570dc8-d8a6-4e3f-8b73-d21cddff60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:16.102239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 677/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:20.299293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba7f5c-ccca-4b01-a256-b34d95f3ba4d None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:20.299806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba7f5c-ccca-4b01-a256-b34d95f3ba4d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:20.299806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba7f5c-ccca-4b01-a256-b34d95f3ba4d None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:20.303172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 679/1356] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:20.306705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d632-63e5-4564-8782-bd6f715cdd9c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:20.307177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d632-63e5-4564-8782-bd6f715cdd9c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:20.307306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d632-63e5-4564-8782-bd6f715cdd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:20.327689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b763d632-63e5-4564-8782-bd6f715cdd9c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:20.328906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b763d632-63e5-4564-8782-bd6f715cdd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:20.339509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 678/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:40:20.385315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943969-6485-43b4-908d-bdc943442f54 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:20.385848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943969-6485-43b4-908d-bdc943442f54 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:20.386128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943969-6485-43b4-908d-bdc943442f54 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:20.387514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 680/1358] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 10 16:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:20.394472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2735a-7b29-430b-a1e5-f9355cb8368c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:20.395013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2735a-7b29-430b-a1e5-f9355cb8368c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:20.395295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2735a-7b29-430b-a1e5-f9355cb8368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:20.447147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5cc2735a-7b29-430b-a1e5-f9355cb8368c None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:20.448392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5cc2735a-7b29-430b-a1e5-f9355cb8368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:20.540429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 679/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 10 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:20.544381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04943969-6485-43b4-908d-bdc943442f54 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:20.560641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04943969-6485-43b4-908d-bdc943442f54 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:20.567418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:20.568538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:20.568877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:20.569225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:20.581283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:20.582953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc4107-ae7e-4f51-a6cc-f235da809fb9 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:20.593002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 681/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:23.091232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2230-4150-4196-ac60-8a7f11a36ff5 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:23.091764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2230-4150-4196-ac60-8a7f11a36ff5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:23.091880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2230-4150-4196-ac60-8a7f11a36ff5 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:23.093435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 680/1361] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:23.099571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cea2-aee9-4c1b-98d3-828eecff8326 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:23.100043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cea2-aee9-4c1b-98d3-828eecff8326 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:23.100125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cea2-aee9-4c1b-98d3-828eecff8326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:23.117908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6d55cea2-aee9-4c1b-98d3-828eecff8326 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:23.119099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6d55cea2-aee9-4c1b-98d3-828eecff8326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:23.128352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 682/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:23.171138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2230-4150-4196-ac60-8a7f11a36ff5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:23.188003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2230-4150-4196-ac60-8a7f11a36ff5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:23.196890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:23.197546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:23.197837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:23.198114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:23.210011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:23.211743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04df04-fbf2-46d9-b951-a50fd2b59067 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:23.227333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 681/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:25.794807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64330fe-b30a-420d-9919-70c65c6b2709 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:25.795366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64330fe-b30a-420d-9919-70c65c6b2709 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:25.795452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64330fe-b30a-420d-9919-70c65c6b2709 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:25.796830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 683/1364] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:25.803314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e240-2863-4618-b447-08c3f14dca74 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:25.803750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e240-2863-4618-b447-08c3f14dca74 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:25.803846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e240-2863-4618-b447-08c3f14dca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:25.823217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-74c2e240-2863-4618-b447-08c3f14dca74 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:25.824800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-74c2e240-2863-4618-b447-08c3f14dca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:25.833435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 682/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:25.883475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695374a4-f47f-4e73-a801-1839a951d9ca None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:25.883766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695374a4-f47f-4e73-a801-1839a951d9ca None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:25.884039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695374a4-f47f-4e73-a801-1839a951d9ca None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:25.885486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 684/1366] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 10 16:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:25.890845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e092-815a-4e85-8113-dc520d7e989c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:25.891131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e092-815a-4e85-8113-dc520d7e989c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:25.891405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e092-815a-4e85-8113-dc520d7e989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:25.911948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-08e8e092-815a-4e85-8113-dc520d7e989c None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:25.913716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-08e8e092-815a-4e85-8113-dc520d7e989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:25.924061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 683/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 10 16:40:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:25.935698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695374a4-f47f-4e73-a801-1839a951d9ca None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:25.951582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695374a4-f47f-4e73-a801-1839a951d9ca None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:25.957730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:25.958505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:25.958795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:25.959070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:25.968751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:25.970433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7c067-0f98-44bc-929f-2fe429302d39 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:25.979999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 685/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:28.753130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2abb-cc36-4ff3-83e2-a3b5491bf0b0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:28.753731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2abb-cc36-4ff3-83e2-a3b5491bf0b0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:28.753731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d2abb-cc36-4ff3-83e2-a3b5491bf0b0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:28.755262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 684/1369] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:28.760809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5490df-c638-4923-93cd-e1bd7d54b80e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:28.761294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5490df-c638-4923-93cd-e1bd7d54b80e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:28.761398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5490df-c638-4923-93cd-e1bd7d54b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:28.786410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1e5490df-c638-4923-93cd-e1bd7d54b80e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:28.787617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1e5490df-c638-4923-93cd-e1bd7d54b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:28.797592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 686/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:28.850901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2abb-cc36-4ff3-83e2-a3b5491bf0b0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:28.870704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d2abb-cc36-4ff3-83e2-a3b5491bf0b0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:28.879523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:28.880327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:28.880678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:28.881070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:28.894591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:28.896780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c1be5-b2c0-4fb1-b6a4-693247774659 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:28.917107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 685/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:29.120553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e18a2-804d-4914-b00c-a304123f30b0 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:29.121006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e18a2-804d-4914-b00c-a304123f30b0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:29.121382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e18a2-804d-4914-b00c-a304123f30b0 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:29.123130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 687/1372] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:29.129841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f1f2-212d-4c4c-ab51-e7d10d51094f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:29.130179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f1f2-212d-4c4c-ab51-e7d10d51094f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:29.130422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f1f2-212d-4c4c-ab51-e7d10d51094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:29.150923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6fa6f1f2-212d-4c4c-ab51-e7d10d51094f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:29.152163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6fa6f1f2-212d-4c4c-ab51-e7d10d51094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:29.161205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 686/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:29.488399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33b2a-9a6d-4bc5-b938-4fd856f490f2 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:29.488717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33b2a-9a6d-4bc5-b938-4fd856f490f2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:29.489107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33b2a-9a6d-4bc5-b938-4fd856f490f2 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:29.490545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 688/1374] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 10 16:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:29.495919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1a23-be9c-440b-ba98-1539e4271520 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:29.496211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1a23-be9c-440b-ba98-1539e4271520 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:29.496526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1a23-be9c-440b-ba98-1539e4271520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:29.559915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b17e1a23-be9c-440b-ba98-1539e4271520 None None] MFA Rules not processed for user `df7219cea0ae464e8df960dd38906b01`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:29.561584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b17e1a23-be9c-440b-ba98-1539e4271520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:29.629829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 687/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 10 16:40:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:29.639132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33b2a-9a6d-4bc5-b938-4fd856f490f2 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:29.649879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33b2a-9a6d-4bc5-b938-4fd856f490f2 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:29.653299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:29.653929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:29.654217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:29.654475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:29.664375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:29.665848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a6c7-fd0e-493e-a22c-92b58e772778 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:29.676493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 689/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:40:31.414297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c20bf-398e-4368-9c30-9c623915dca0 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:31.414865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c20bf-398e-4368-9c30-9c623915dca0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:31.414865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c20bf-398e-4368-9c30-9c623915dca0 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:31.416228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 688/1377] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:31.421831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048b37-4414-48ad-804e-2889f5f2d0a0 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:31.422288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048b37-4414-48ad-804e-2889f5f2d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:31.422382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18048b37-4414-48ad-804e-2889f5f2d0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:31.449423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-18048b37-4414-48ad-804e-2889f5f2d0a0 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:31.450625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-18048b37-4414-48ad-804e-2889f5f2d0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:31.459341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 690/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:31.505932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c20bf-398e-4368-9c30-9c623915dca0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:31.522309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c20bf-398e-4368-9c30-9c623915dca0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:31.528044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:31.528735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:31.529021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:31.529306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:31.538896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:31.540527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524dbb8-7594-44ab-b174-caa972931b2d service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:31.552198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 689/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:33.943624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3d2-4620-4ab9-b5b5-2fe372b3fb41 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:33.944237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3d2-4620-4ab9-b5b5-2fe372b3fb41 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:33.944237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3d2-4620-4ab9-b5b5-2fe372b3fb41 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:33.945592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 691/1380] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:33.951150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342019c6-28c9-42ac-a030-495b11fd89e4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:33.951622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342019c6-28c9-42ac-a030-495b11fd89e4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:33.951906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342019c6-28c9-42ac-a030-495b11fd89e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:33.971506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-342019c6-28c9-42ac-a030-495b11fd89e4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:33.972887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-342019c6-28c9-42ac-a030-495b11fd89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:33.981239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 690/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:34.028034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a3d2-4620-4ab9-b5b5-2fe372b3fb41 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:34.042918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a3d2-4620-4ab9-b5b5-2fe372b3fb41 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:34.049682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:34.050322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:34.050610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:34.050890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:34.059138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:34.060746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693d61f-1795-4e0a-a1cf-a196f5006ad3 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:34.071634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 692/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:36.392375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50fe-4f0b-4f5f-b8e7-c7ae219b7b3a None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:36.393075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50fe-4f0b-4f5f-b8e7-c7ae219b7b3a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:36.393075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f50fe-4f0b-4f5f-b8e7-c7ae219b7b3a None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:36.395276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 691/1383] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:36.401572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3d913-49d0-48af-ba3b-1fbe3f918559 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:36.402101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3d913-49d0-48af-ba3b-1fbe3f918559 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:36.402101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3d913-49d0-48af-ba3b-1fbe3f918559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:36.420026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1fb3d913-49d0-48af-ba3b-1fbe3f918559 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:36.421950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1fb3d913-49d0-48af-ba3b-1fbe3f918559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:36.431516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 693/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:36.481313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f50fe-4f0b-4f5f-b8e7-c7ae219b7b3a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:36.493078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f50fe-4f0b-4f5f-b8e7-c7ae219b7b3a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:36.505442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:36.506620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:36.507344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:36.507867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:36.520051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:36.522061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059567be-5d0e-4ee5-b385-3285ccbc97a5 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:36.532035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 692/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:39.102883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d8c6-cf01-41b2-b1b6-b8b88a8237b1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:39.103473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d8c6-cf01-41b2-b1b6-b8b88a8237b1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:39.103573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d8c6-cf01-41b2-b1b6-b8b88a8237b1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:39.105482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 694/1386] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:39.112048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838086-8462-40db-9bd6-599bf1c3db19 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:39.112689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838086-8462-40db-9bd6-599bf1c3db19 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:39.113192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76838086-8462-40db-9bd6-599bf1c3db19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:39.133420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-76838086-8462-40db-9bd6-599bf1c3db19 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:39.134748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-76838086-8462-40db-9bd6-599bf1c3db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:39.143795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 693/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:40:39.196213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d8c6-cf01-41b2-b1b6-b8b88a8237b1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:39.212073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d8c6-cf01-41b2-b1b6-b8b88a8237b1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:39.217673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:39.218332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:39.218593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:39.218866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:39.227548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:39.229152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7ad1d-3788-4b2f-adf5-0b72fa25778e service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:39.239298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 695/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:42.183856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cde9-f52e-4d60-98ee-e4516a9137ce None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:42.184457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cde9-f52e-4d60-98ee-e4516a9137ce None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:42.184457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cde9-f52e-4d60-98ee-e4516a9137ce None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:42.185798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 694/1389] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:42.191318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45702b-5f17-4b8f-8757-5791a69e3736 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:42.191773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45702b-5f17-4b8f-8757-5791a69e3736 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:42.191870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45702b-5f17-4b8f-8757-5791a69e3736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:42.210871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-da45702b-5f17-4b8f-8757-5791a69e3736 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:42.212053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-da45702b-5f17-4b8f-8757-5791a69e3736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:42.221611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 696/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:40:42.273026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506cde9-f52e-4d60-98ee-e4516a9137ce None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:42.288220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506cde9-f52e-4d60-98ee-e4516a9137ce None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:42.294209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:42.294850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:42.295194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:42.295473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:42.304452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:42.306029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3310aef-866f-438e-a4bc-2d12087296f4 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:42.316435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 695/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:44.711692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882d7b-e8bc-4d40-914f-4f7cdbe9c108 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:44.712338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882d7b-e8bc-4d40-914f-4f7cdbe9c108 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:44.712338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d882d7b-e8bc-4d40-914f-4f7cdbe9c108 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:44.713643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 697/1392] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:44.718992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dbdc-74d9-438d-9e81-02b462d1de3f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:44.719468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dbdc-74d9-438d-9e81-02b462d1de3f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:44.719576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39dbdc-74d9-438d-9e81-02b462d1de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:44.743556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6e39dbdc-74d9-438d-9e81-02b462d1de3f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:44.744782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6e39dbdc-74d9-438d-9e81-02b462d1de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:44.753191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 696/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:44.811632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d882d7b-e8bc-4d40-914f-4f7cdbe9c108 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:44.826863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d882d7b-e8bc-4d40-914f-4f7cdbe9c108 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:44.835824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:44.837073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:44.837581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:44.838087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:44.850006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:44.851748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0556dd-fccd-4384-8df8-e974e9ad1c45 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:44.864489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 698/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:45.795289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fba75-0941-4268-a88a-55141f737463 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:45.795894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fba75-0941-4268-a88a-55141f737463 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:45.795894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fba75-0941-4268-a88a-55141f737463 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:45.797327 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 697/1395] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:45.804026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730ac62-04d1-45d0-93e4-d436ec0410e2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:45.804770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730ac62-04d1-45d0-93e4-d436ec0410e2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:45.804770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730ac62-04d1-45d0-93e4-d436ec0410e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:45.827592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a730ac62-04d1-45d0-93e4-d436ec0410e2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:45.829412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a730ac62-04d1-45d0-93e4-d436ec0410e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:45.838727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 699/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:45.904092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c09f-313c-49fc-b974-9980d08f2db8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:45.904685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c09f-313c-49fc-b974-9980d08f2db8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:45.905347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33c09f-313c-49fc-b974-9980d08f2db8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:45.907258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 698/1397] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 10 16:40:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:45.915045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5217a-498e-4ec3-b503-eb155575b1fc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:45.915462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5217a-498e-4ec3-b503-eb155575b1fc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:45.915811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5217a-498e-4ec3-b503-eb155575b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:45.975680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e6f5217a-498e-4ec3-b503-eb155575b1fc None None] MFA Rules not processed for user `64b24a8c20fd44f99cd7d961c259ce0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:45.977063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e6f5217a-498e-4ec3-b503-eb155575b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:46.043559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 700/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 10 16:40:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:46.054998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c09f-313c-49fc-b974-9980d08f2db8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:46.075280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33c09f-313c-49fc-b974-9980d08f2db8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:46.082118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:46.083186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:46.083697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:46.084199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:46.102544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:46.103991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8647a-c913-4011-aa28-182544df26eb service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:46.114673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 699/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:46.632165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069d52-5691-4d5b-a806-4a7d57d23705 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:46.634804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069d52-5691-4d5b-a806-4a7d57d23705 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:46.635290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069d52-5691-4d5b-a806-4a7d57d23705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:46.689554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0a069d52-5691-4d5b-a806-4a7d57d23705 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:46.691346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0a069d52-5691-4d5b-a806-4a7d57d23705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:46.765737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 701/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:46.813735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c69c-6bc7-4ca6-95b4-d8d7e9bc239c None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:46.814292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c69c-6bc7-4ca6-95b4-d8d7e9bc239c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:46.815198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820c69c-6bc7-4ca6-95b4-d8d7e9bc239c None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:46.816868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 700/1401] 10.222.0.48 () {54 vars in 942 bytes} [Tue May 10 16:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:46.823589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13401c0-b23d-4866-9401-2f4328c95e39 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:46.824205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13401c0-b23d-4866-9401-2f4328c95e39 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:46.824205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13401c0-b23d-4866-9401-2f4328c95e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:46.882113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a13401c0-b23d-4866-9401-2f4328c95e39 None None] MFA Rules not processed for user `74292c819dee46f788c7b9af0b9fce7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:46.883236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a13401c0-b23d-4866-9401-2f4328c95e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:46.971952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 702/1402] 10.222.0.48 () {58 vars in 1039 bytes} [Tue May 10 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:46.983127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820c69c-6bc7-4ca6-95b4-d8d7e9bc239c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:47.003686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820c69c-6bc7-4ca6-95b4-d8d7e9bc239c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:47.008780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:47.009587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:47.010025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:47.010540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:47.019939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:47.021624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9528b3-5322-4af8-9bb7-c39a7bef9c07 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:47.030343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 701/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 16:40:47.242971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b511e-cf94-4c86-8d1b-6558d48955fc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:47.243254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b511e-cf94-4c86-8d1b-6558d48955fc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:47.243697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b511e-cf94-4c86-8d1b-6558d48955fc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:47.246748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 703/1404] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:40:47.252049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358321-1fed-41bf-80be-d2f9685bc118 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:47.252447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358321-1fed-41bf-80be-d2f9685bc118 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:47.252799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1358321-1fed-41bf-80be-d2f9685bc118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:47.273505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e1358321-1fed-41bf-80be-d2f9685bc118 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:47.275232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e1358321-1fed-41bf-80be-d2f9685bc118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:47.294098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 702/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:40:47.347636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b511e-cf94-4c86-8d1b-6558d48955fc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:47.368493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b511e-cf94-4c86-8d1b-6558d48955fc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:47.374432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:47.375157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:47.375515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:47.375855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:47.387615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:47.389437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea717743-4c36-4c74-aedb-e9b8f58ac405 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:47.404730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 704/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:40:49.960617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1c4e-b27e-43f6-8f15-3e811a7de080 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:49.961552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1c4e-b27e-43f6-8f15-3e811a7de080 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:49.961841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a1c4e-b27e-43f6-8f15-3e811a7de080 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:49.963232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 703/1407] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:40:49.969082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f37e-7125-4f4d-b19a-0fa738a8ea3e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:49.970531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f37e-7125-4f4d-b19a-0fa738a8ea3e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:49.970531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3f37e-7125-4f4d-b19a-0fa738a8ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:49.999731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-79e3f37e-7125-4f4d-b19a-0fa738a8ea3e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:40:49.999731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-79e3f37e-7125-4f4d-b19a-0fa738a8ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:40:50.007581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 705/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:40:50.054061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1c4e-b27e-43f6-8f15-3e811a7de080 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:40:50.070927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a1c4e-b27e-43f6-8f15-3e811a7de080 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:40:50.076838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:40:50.077743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:40:50.078056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:40:50.078333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:40:50.088414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:40:50.089995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92105094-26d8-4389-bd78-ff9d183e9723 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:40:50.102191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 704/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:11.357670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd966-ab64-4a00-b581-12d3d9a9f8dc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:11.358335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd966-ab64-4a00-b581-12d3d9a9f8dc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:11.358335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd966-ab64-4a00-b581-12d3d9a9f8dc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:11.359729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 706/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 10 16:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:11.366248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3adc1-d4a2-4552-a025-4d39612c170a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:11.367005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3adc1-d4a2-4552-a025-4d39612c170a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:11.367005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3adc1-d4a2-4552-a025-4d39612c170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:11.385707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-74a3adc1-d4a2-4552-a025-4d39612c170a None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:11.386916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-74a3adc1-d4a2-4552-a025-4d39612c170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:11.396239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 705/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 10 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:41:11.412427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79746f-f3d5-43a4-ac75-8fd37fe7aebf None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:11.412773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79746f-f3d5-43a4-ac75-8fd37fe7aebf None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:11.413183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79746f-f3d5-43a4-ac75-8fd37fe7aebf None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:11.414865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 707/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue May 10 16:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:41:11.420791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c12a-a8e2-4229-880f-99968720106a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:11.421438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c12a-a8e2-4229-880f-99968720106a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:11.421862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04c12a-a8e2-4229-880f-99968720106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:11.444407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6d04c12a-a8e2-4229-880f-99968720106a None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:11.445604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6d04c12a-a8e2-4229-880f-99968720106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:11.455216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 706/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue May 10 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:14.429611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbce15-d487-4ebd-a24f-3005e51c41a6 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:14.430187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbce15-d487-4ebd-a24f-3005e51c41a6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:14.430187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbce15-d487-4ebd-a24f-3005e51c41a6 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:14.431558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:14.437044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758dbda-fb30-41a2-892b-df5fd3c90ed1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:14.437505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758dbda-fb30-41a2-892b-df5fd3c90ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:14.437637 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758dbda-fb30-41a2-892b-df5fd3c90ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:14.458195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5758dbda-fb30-41a2-892b-df5fd3c90ed1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:14.459393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5758dbda-fb30-41a2-892b-df5fd3c90ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:14.467229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:41:14.509009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbce15-d487-4ebd-a24f-3005e51c41a6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:14.523457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbce15-d487-4ebd-a24f-3005e51c41a6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:14.528804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:14.529437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:14.529719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:14.529993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:14.541288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:14.542908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5df7ec-5bcc-425a-b508-c6ab95d3ee4d service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:14.552788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 709/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:15.583965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6d2a-b77e-4839-819d-3da2cf3d01d8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.584454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6d2a-b77e-4839-819d-3da2cf3d01d8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.584571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be6d2a-b77e-4839-819d-3da2cf3d01d8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.585893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:15.591068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b55d1-e673-40a3-86b9-d25874e28f0b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.591559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b55d1-e673-40a3-86b9-d25874e28f0b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.591654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b55d1-e673-40a3-86b9-d25874e28f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.609615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f57b55d1-e673-40a3-86b9-d25874e28f0b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:15.610817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f57b55d1-e673-40a3-86b9-d25874e28f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:15.618916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:15.814610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be6d2a-b77e-4839-819d-3da2cf3d01d8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:15.829633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be6d2a-b77e-4839-819d-3da2cf3d01d8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:15.838126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:15.838788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:15.839070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:15.839350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:15.849194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:15.850792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57500f94-05dd-4684-b1c8-5cc698d45697 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:15.861047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 709/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:16.865593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1fefc-9aa3-4e00-8ae1-93df147b2569 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.866206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1fefc-9aa3-4e00-8ae1-93df147b2569 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.866206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1fefc-9aa3-4e00-8ae1-93df147b2569 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.867495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:16.874508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a93f-0dfb-408d-a6bc-6fd1ef5b0bc6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:16.874985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a93f-0dfb-408d-a6bc-6fd1ef5b0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:16.875107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a93f-0dfb-408d-a6bc-6fd1ef5b0bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:16.893232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0b43a93f-0dfb-408d-a6bc-6fd1ef5b0bc6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:16.894439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0b43a93f-0dfb-408d-a6bc-6fd1ef5b0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:16.902827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:17.058349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1fefc-9aa3-4e00-8ae1-93df147b2569 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:17.074434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1fefc-9aa3-4e00-8ae1-93df147b2569 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:17.080695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:17.081360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:17.081645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:17.081927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:17.090852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:17.092495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c8525-b785-41dc-a38e-d7f91eb37dc0 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:17.103195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 712/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:18.094962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3478-9473-45f7-91ae-2c15bc852f6b None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:18.095554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3478-9473-45f7-91ae-2c15bc852f6b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:18.095554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3478-9473-45f7-91ae-2c15bc852f6b None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:18.096909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:18.104268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56ef5-4237-4a61-8c5c-f85e22b3bc2e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:18.104897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56ef5-4237-4a61-8c5c-f85e22b3bc2e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:18.105225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f56ef5-4237-4a61-8c5c-f85e22b3bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:18.126365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-43f56ef5-4237-4a61-8c5c-f85e22b3bc2e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:18.127889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-43f56ef5-4237-4a61-8c5c-f85e22b3bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:18.136149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:18.287100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca3478-9473-45f7-91ae-2c15bc852f6b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:18.304209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca3478-9473-45f7-91ae-2c15bc852f6b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:18.309692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:18.310342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:18.310630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:18.310911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:18.319513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:18.321144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd932e-e99a-463d-8a98-17c3e92dc996 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:18.331991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 712/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:19.312933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7af36-623c-46ad-84ec-aaa774dc8b12 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:19.313513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7af36-623c-46ad-84ec-aaa774dc8b12 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:19.313513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7af36-623c-46ad-84ec-aaa774dc8b12 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:19.314771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:19.320120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d531-c6b6-4834-b298-4e3dd00774b7 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:19.320754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d531-c6b6-4834-b298-4e3dd00774b7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:19.320754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d531-c6b6-4834-b298-4e3dd00774b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:19.338262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e524d531-c6b6-4834-b298-4e3dd00774b7 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:19.339457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e524d531-c6b6-4834-b298-4e3dd00774b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:19.348033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:19.497466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7af36-623c-46ad-84ec-aaa774dc8b12 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:19.513288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7af36-623c-46ad-84ec-aaa774dc8b12 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:19.519529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:19.520178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:19.520493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:19.521287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:19.529444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:19.531061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b0ab4-4e18-41ee-abc8-f48f015e2768 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:19.542515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 715/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:20.430044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd72-1314-46a0-a523-9f492677ebaf None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:20.430657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd72-1314-46a0-a523-9f492677ebaf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:20.430765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cd72-1314-46a0-a523-9f492677ebaf None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:20.432091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:20.437095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb6f8-7ec2-4db5-b25d-52c3205c55e1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:20.437523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb6f8-7ec2-4db5-b25d-52c3205c55e1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:20.437646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cb6f8-7ec2-4db5-b25d-52c3205c55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:20.456236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-969cb6f8-7ec2-4db5-b25d-52c3205c55e1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:20.457443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-969cb6f8-7ec2-4db5-b25d-52c3205c55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:20.465466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:20.619430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358cd72-1314-46a0-a523-9f492677ebaf None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:20.633721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358cd72-1314-46a0-a523-9f492677ebaf None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:20.640937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:20.641719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:20.642516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:20.642916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:20.651913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:20.653545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502790-d7c7-46a3-88a9-013b97e4f446 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:20.664707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 715/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:21.555941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94401-0751-440b-b2e4-b845b1d3f538 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:21.556543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94401-0751-440b-b2e4-b845b1d3f538 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:21.556543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94401-0751-440b-b2e4-b845b1d3f538 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:21.557934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:21.563813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774ebd-31c9-47c2-8c21-b4a59c27bb04 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:21.564407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774ebd-31c9-47c2-8c21-b4a59c27bb04 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:21.564407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55774ebd-31c9-47c2-8c21-b4a59c27bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:21.583995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-55774ebd-31c9-47c2-8c21-b4a59c27bb04 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:21.585245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-55774ebd-31c9-47c2-8c21-b4a59c27bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:21.593179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:21.748647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94401-0751-440b-b2e4-b845b1d3f538 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:21.763853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94401-0751-440b-b2e4-b845b1d3f538 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:21.769593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:21.770231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:21.770507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:21.770777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:21.779346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:21.780973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd22b50-e707-4176-b2f6-683f4e903da6 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:21.791385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 718/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:22.689826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412fc0-ae55-4fe0-a023-3c242528ea57 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:22.690347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412fc0-ae55-4fe0-a023-3c242528ea57 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:22.690347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb412fc0-ae55-4fe0-a023-3c242528ea57 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:22.692301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:41:22.697695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9740c-0ee4-4131-a09b-3d71dff1ea08 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:22.698360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9740c-0ee4-4131-a09b-3d71dff1ea08 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:22.698360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9740c-0ee4-4131-a09b-3d71dff1ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:22.716490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-27d9740c-0ee4-4131-a09b-3d71dff1ea08 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:22.717702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-27d9740c-0ee4-4131-a09b-3d71dff1ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:22.726235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:22.879236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412fc0-ae55-4fe0-a023-3c242528ea57 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:22.893879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb412fc0-ae55-4fe0-a023-3c242528ea57 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:22.899230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:22.899878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:22.900164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:22.900482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:22.909692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:22.911291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af953990-0922-4583-9f90-7d1803fb991f service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:22.921969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 718/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:23.811226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267f8b-4e31-405c-8667-dbdce711d61f None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:23.811798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267f8b-4e31-405c-8667-dbdce711d61f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:23.811798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31267f8b-4e31-405c-8667-dbdce711d61f None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:23.813176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:23.818569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b902-dda0-48a1-98a5-2d37c9ce9f69 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:23.819084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b902-dda0-48a1-98a5-2d37c9ce9f69 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:23.819189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893b902-dda0-48a1-98a5-2d37c9ce9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:23.837470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d893b902-dda0-48a1-98a5-2d37c9ce9f69 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:23.838635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d893b902-dda0-48a1-98a5-2d37c9ce9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:23.848129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:24.003081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31267f8b-4e31-405c-8667-dbdce711d61f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:24.018506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31267f8b-4e31-405c-8667-dbdce711d61f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:24.023956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:24.024632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:24.024918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:24.025198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:24.034660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:24.036261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09842c90-6c2a-4d72-8101-4bbf44f4e96c service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:24.045995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 721/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:26.373386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45a26-c938-4559-916e-e6b7b2e0bd19 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:26.373816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45a26-c938-4559-916e-e6b7b2e0bd19 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:26.373945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45a26-c938-4559-916e-e6b7b2e0bd19 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:26.375325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:26.381004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572c39-01f3-450a-9335-3c3f18c08934 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:26.381509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572c39-01f3-450a-9335-3c3f18c08934 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:26.381607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572c39-01f3-450a-9335-3c3f18c08934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:26.402153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-aa572c39-01f3-450a-9335-3c3f18c08934 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:26.403368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-aa572c39-01f3-450a-9335-3c3f18c08934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:26.414910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:26.453163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45a26-c938-4559-916e-e6b7b2e0bd19 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:26.464902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45a26-c938-4559-916e-e6b7b2e0bd19 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:26.471137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:26.471806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:26.472095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:26.472400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:26.481975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:26.483428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f09598-a4f8-4dba-8b44-1aef3e6c7a65 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:26.494915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 721/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:29.028619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddb5a-6055-4795-9a6c-df5bf6a7fe90 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:29.029213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddb5a-6055-4795-9a6c-df5bf6a7fe90 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:29.029410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddb5a-6055-4795-9a6c-df5bf6a7fe90 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:29.031462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:29.037035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28dc5-a24b-4755-a534-c53a7ba07661 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:29.037540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28dc5-a24b-4755-a534-c53a7ba07661 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:29.037649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28dc5-a24b-4755-a534-c53a7ba07661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:29.055402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-67e28dc5-a24b-4755-a534-c53a7ba07661 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:29.056644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-67e28dc5-a24b-4755-a534-c53a7ba07661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:29.065592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:29.103384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eddb5a-6055-4795-9a6c-df5bf6a7fe90 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:29.114144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eddb5a-6055-4795-9a6c-df5bf6a7fe90 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:29.117715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:29.118381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:29.118661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:29.118935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:29.129123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:29.130604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e08169-fff9-4a9c-9e95-02a516364229 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:29.140742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 724/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:31.809303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c105-a2bf-427f-970f-3ff1e79aa408 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:31.809919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c105-a2bf-427f-970f-3ff1e79aa408 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:31.809919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c105-a2bf-427f-970f-3ff1e79aa408 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:31.811667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:31.817868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3abe-19a1-41c7-aab8-1d05dfd1cce4 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:31.818388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3abe-19a1-41c7-aab8-1d05dfd1cce4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:31.818501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c3abe-19a1-41c7-aab8-1d05dfd1cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:31.835910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b28c3abe-19a1-41c7-aab8-1d05dfd1cce4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:31.837054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b28c3abe-19a1-41c7-aab8-1d05dfd1cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:31.845339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:31.883959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c105-a2bf-427f-970f-3ff1e79aa408 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:31.894554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c105-a2bf-427f-970f-3ff1e79aa408 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:31.898043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:31.898676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:31.898961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:31.899231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:31.909377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:31.910814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bedac-2581-4921-abcf-78ead6c8cb81 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:31.920047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 724/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:34.399696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d91c-9aaa-4889-9974-d27786e2bac0 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:34.400223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d91c-9aaa-4889-9974-d27786e2bac0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:34.400223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5d91c-9aaa-4889-9974-d27786e2bac0 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:34.401630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:34.407567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eed85-3701-4d0b-863d-abbf216c57cd None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:34.408015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eed85-3701-4d0b-863d-abbf216c57cd None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:34.408119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2eed85-3701-4d0b-863d-abbf216c57cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:34.428298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-dc2eed85-3701-4d0b-863d-abbf216c57cd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:34.429524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dc2eed85-3701-4d0b-863d-abbf216c57cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:34.438056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:34.478710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5d91c-9aaa-4889-9974-d27786e2bac0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:34.490465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5d91c-9aaa-4889-9974-d27786e2bac0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:34.494342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:34.494992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:34.495275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:34.495550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:34.504863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:34.506314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6b9ff-d029-499d-9ea5-9e33c1a014b9 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:34.520369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 727/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:36.908664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31ee59-9f7b-4aca-84d7-6e17997e58c3 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:36.909260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31ee59-9f7b-4aca-84d7-6e17997e58c3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:36.909260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31ee59-9f7b-4aca-84d7-6e17997e58c3 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:36.910598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:36.915975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5ce7-0035-4499-a9a5-d8c7e82c0303 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:36.916423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5ce7-0035-4499-a9a5-d8c7e82c0303 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:36.916564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5ce7-0035-4499-a9a5-d8c7e82c0303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:36.934292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-8cdf5ce7-0035-4499-a9a5-d8c7e82c0303 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:36.935460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8cdf5ce7-0035-4499-a9a5-d8c7e82c0303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:36.943907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:41:36.981019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31ee59-9f7b-4aca-84d7-6e17997e58c3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:36.992340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31ee59-9f7b-4aca-84d7-6e17997e58c3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:36.995848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:36.996595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:36.996883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:36.997162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:37.006533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:37.007978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895bdf7-7d48-44dd-9696-47d6d094ea38 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:37.017179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 727/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:39.338802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41880-6345-48a4-a1f5-c3131d1caa86 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:39.339353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41880-6345-48a4-a1f5-c3131d1caa86 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:39.339353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41880-6345-48a4-a1f5-c3131d1caa86 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:39.340738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:39.346952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b74f-7580-48dc-ad73-32a832035d1d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:39.347416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b74f-7580-48dc-ad73-32a832035d1d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:39.347529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b74f-7580-48dc-ad73-32a832035d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:39.364696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-97a6b74f-7580-48dc-ad73-32a832035d1d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:39.365885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-97a6b74f-7580-48dc-ad73-32a832035d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:39.373624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:39.412981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e41880-6345-48a4-a1f5-c3131d1caa86 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:39.424019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e41880-6345-48a4-a1f5-c3131d1caa86 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:39.427821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:39.428494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:39.428779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:39.429054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:39.437974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:39.440021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aa0fa-9814-45c6-aef4-d22d6c8d365d service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:39.449495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 730/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:41.834124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfa6f-f3ce-4ec5-a4db-549cfed2fac8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:41.834700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfa6f-f3ce-4ec5-a4db-549cfed2fac8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:41.834700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cfa6f-f3ce-4ec5-a4db-549cfed2fac8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:41.836004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:41:41.841782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21608-bc87-432f-a22a-996217e29279 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:41.842250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21608-bc87-432f-a22a-996217e29279 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:41.842357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21608-bc87-432f-a22a-996217e29279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:41.862314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-99a21608-bc87-432f-a22a-996217e29279 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:41.863509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-99a21608-bc87-432f-a22a-996217e29279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:41.871283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:41.908998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cfa6f-f3ce-4ec5-a4db-549cfed2fac8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:41.919488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cfa6f-f3ce-4ec5-a4db-549cfed2fac8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:41.924105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:41.925028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:41.925345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:41.925626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:41.935001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:41.936449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e963cc-9073-461a-9c92-9bcbfb5fb262 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:41.948141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 730/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:44.388798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043063-7a87-429d-a14e-20c218ef2f24 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:44.389290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043063-7a87-429d-a14e-20c218ef2f24 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:44.389397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00043063-7a87-429d-a14e-20c218ef2f24 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:44.390782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:44.396844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7e-4260-4ea4-a30e-437e82cd0fc6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:44.397273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7e-4260-4ea4-a30e-437e82cd0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:44.397409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b50f7e-4260-4ea4-a30e-437e82cd0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:44.416360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-78b50f7e-4260-4ea4-a30e-437e82cd0fc6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:44.417564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-78b50f7e-4260-4ea4-a30e-437e82cd0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:44.425783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:44.470247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043063-7a87-429d-a14e-20c218ef2f24 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:44.481481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00043063-7a87-429d-a14e-20c218ef2f24 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:44.484979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:44.486013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:44.486305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:44.486578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:44.495559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:44.497004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d34952-ef9f-4752-bf67-e20ee9a0871d service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:44.506327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 733/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:46.852543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a724-836c-48c9-ac35-c686b8158c01 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:46.853080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a724-836c-48c9-ac35-c686b8158c01 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:46.853203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a724-836c-48c9-ac35-c686b8158c01 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:46.854986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:46.862469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eadfe-6ffa-42e6-9aab-24a9f2526aa9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:46.862913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eadfe-6ffa-42e6-9aab-24a9f2526aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:46.863034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150eadfe-6ffa-42e6-9aab-24a9f2526aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:46.881438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-150eadfe-6ffa-42e6-9aab-24a9f2526aa9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:46.883283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-150eadfe-6ffa-42e6-9aab-24a9f2526aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:46.894148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:46.932383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a724-836c-48c9-ac35-c686b8158c01 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:46.943135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a724-836c-48c9-ac35-c686b8158c01 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:46.946744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:46.947385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:46.947671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:46.947949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:46.957402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:46.958842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb23a8-af76-462d-b892-d23498938774 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:46.968771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 733/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:41:49.269693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da589-9f81-4bb4-935e-aa28b5e46e7b None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:49.270258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da589-9f81-4bb4-935e-aa28b5e46e7b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:49.270258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4da589-9f81-4bb4-935e-aa28b5e46e7b None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:49.271660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:41:49.276968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80868c6-2afc-4fe1-98b9-24f3f58498cf None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:49.277405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80868c6-2afc-4fe1-98b9-24f3f58498cf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:49.277542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80868c6-2afc-4fe1-98b9-24f3f58498cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:49.302051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c80868c6-2afc-4fe1-98b9-24f3f58498cf None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:41:49.304143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c80868c6-2afc-4fe1-98b9-24f3f58498cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:41:49.321986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:41:49.353238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da589-9f81-4bb4-935e-aa28b5e46e7b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:41:49.364374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4da589-9f81-4bb4-935e-aa28b5e46e7b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:41:49.367976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:41:49.368668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:41:49.368953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:41:49.369225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:41:49.379058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:41:49.381370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a5782-7eda-4b40-bbfa-64021220d595 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:41:49.393386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 736/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:24.596582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b596c-e677-4623-8a75-63365a318e8d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:24.597356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b596c-e677-4623-8a75-63365a318e8d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:24.597356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b596c-e677-4623-8a75-63365a318e8d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:24.598544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 735/1471] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:24.604651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b267-640e-46fa-aa45-a9550454679c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:24.605180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b267-640e-46fa-aa45-a9550454679c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:24.605290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81b267-640e-46fa-aa45-a9550454679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:24.626799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4c81b267-640e-46fa-aa45-a9550454679c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:24.628081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4c81b267-640e-46fa-aa45-a9550454679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:24.638199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 737/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:24.692631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a2-51d3-447d-91ce-696ff47ed65e None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:24.692917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a2-51d3-447d-91ce-696ff47ed65e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:24.693197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87128a2-51d3-447d-91ce-696ff47ed65e None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:24.694650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 736/1473] 10.222.0.48 () {54 vars in 962 bytes} [Tue May 10 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:24.699760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053e90-51c4-40ea-98ee-0165b7bd01b1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:24.700049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053e90-51c4-40ea-98ee-0165b7bd01b1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:24.700350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52053e90-51c4-40ea-98ee-0165b7bd01b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:24.719760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-52053e90-51c4-40ea-98ee-0165b7bd01b1 None None] MFA Rules not processed for user `64b24a8c20fd44f99cd7d961c259ce0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:24.720989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52053e90-51c4-40ea-98ee-0165b7bd01b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:24.727555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 738/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Tue May 10 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:24.736987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87128a2-51d3-447d-91ce-696ff47ed65e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:24.748608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87128a2-51d3-447d-91ce-696ff47ed65e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:24.754170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:24.754854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:24.755195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:24.755499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:24.768854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:24.771001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6bd7f-e582-4dd5-be0f-eb96753c8c9c service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:24.785545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 737/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:27.272499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeedfa-2623-4586-b3f8-c6b10026bcfc None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:27.273131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeedfa-2623-4586-b3f8-c6b10026bcfc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:27.273131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfeedfa-2623-4586-b3f8-c6b10026bcfc None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:27.274495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 739/1476] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:27.280166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fda9-3e57-4253-bc5f-5343d5e57f4d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:27.280913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fda9-3e57-4253-bc5f-5343d5e57f4d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:27.280913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681fda9-3e57-4253-bc5f-5343d5e57f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:27.300887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3681fda9-3e57-4253-bc5f-5343d5e57f4d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:27.302334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3681fda9-3e57-4253-bc5f-5343d5e57f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:27.311644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 738/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:27.335147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeedfa-2623-4586-b3f8-c6b10026bcfc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:27.356724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfeedfa-2623-4586-b3f8-c6b10026bcfc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:27.361380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:27.362049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:27.362330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:27.362603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:27.363478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:27.365799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:42:27.365799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:42:27.365799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:42:27.366971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8f6df-ac7b-4b62-a360-862c7c1c1d40 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:27.389559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 740/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue May 10 16:42:27 2022] GET /identity/v3/projects => generated 2553 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:42:29.874683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268ae7-cbb8-493b-8258-cefb60fe83fe None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:29.875442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268ae7-cbb8-493b-8258-cefb60fe83fe None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:29.875540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268ae7-cbb8-493b-8258-cefb60fe83fe None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:29.877288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 739/1479] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:29.883137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1349-2029-45ac-b021-883bc68cc2e5 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:29.883646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1349-2029-45ac-b021-883bc68cc2e5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:29.883755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e1349-2029-45ac-b021-883bc68cc2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:29.901938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ce5e1349-2029-45ac-b021-883bc68cc2e5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:29.903196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ce5e1349-2029-45ac-b021-883bc68cc2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:29.912684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 741/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:29.960209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268ae7-cbb8-493b-8258-cefb60fe83fe None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:29.975227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268ae7-cbb8-493b-8258-cefb60fe83fe None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:29.980704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:29.981366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:29.981651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:29.981931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:29.991547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:29.993194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ca79c-cdd2-4adb-85ad-57cb14829ac7 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:30.008727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 740/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:32.693910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c48-9922-4b30-b4b7-6a78b11cf404 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:32.694510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c48-9922-4b30-b4b7-6a78b11cf404 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:32.694510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4799c48-9922-4b30-b4b7-6a78b11cf404 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:32.695791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 742/1482] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:32.701405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc89a3-da0a-4f40-a136-c05b679ce949 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:32.701868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc89a3-da0a-4f40-a136-c05b679ce949 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:32.701971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc89a3-da0a-4f40-a136-c05b679ce949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:32.720216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-01cc89a3-da0a-4f40-a136-c05b679ce949 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:32.721536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-01cc89a3-da0a-4f40-a136-c05b679ce949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:32.730266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 741/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:32.765867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4799c48-9922-4b30-b4b7-6a78b11cf404 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:32.783577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4799c48-9922-4b30-b4b7-6a78b11cf404 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:32.787452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:32.788163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:32.788591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:32.788933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:32.799050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:32.800815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb88571-bd2d-4148-a4e4-8acf164d8701 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:32.810832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 743/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:35.111129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc6639-7e91-487f-9af7-5ba499560997 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:35.111705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc6639-7e91-487f-9af7-5ba499560997 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:35.111705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc6639-7e91-487f-9af7-5ba499560997 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:35.113098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 742/1485] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:35.118629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820edf-e530-4404-8696-5e9dac401678 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:35.119081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820edf-e530-4404-8696-5e9dac401678 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:35.119263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08820edf-e530-4404-8696-5e9dac401678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:35.137959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-08820edf-e530-4404-8696-5e9dac401678 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:35.139133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-08820edf-e530-4404-8696-5e9dac401678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:35.147637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 744/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:35.185673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc6639-7e91-487f-9af7-5ba499560997 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:35.197469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc6639-7e91-487f-9af7-5ba499560997 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:35.200938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:35.201571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:35.201853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:35.202126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:35.211631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:35.213084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30070b6-911e-4ef2-a5bb-6963598d0d9e service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:35.222594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 743/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:37.559893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924cc3-01d1-4c62-a3ab-68fb7d95e28e None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:37.560571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924cc3-01d1-4c62-a3ab-68fb7d95e28e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:37.560571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27924cc3-01d1-4c62-a3ab-68fb7d95e28e None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:37.561851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 745/1488] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:37.567306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebec09-690a-49f0-ade3-9e71d0195e81 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:37.567791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebec09-690a-49f0-ade3-9e71d0195e81 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:37.567905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebec09-690a-49f0-ade3-9e71d0195e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:37.589014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6cebec09-690a-49f0-ade3-9e71d0195e81 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:37.590230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6cebec09-690a-49f0-ade3-9e71d0195e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:37.600635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 744/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:37.649706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27924cc3-01d1-4c62-a3ab-68fb7d95e28e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:37.662776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27924cc3-01d1-4c62-a3ab-68fb7d95e28e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:37.666632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:37.667279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:37.667571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:37.667843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:37.678089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:37.679570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec316407-2cb9-44cb-ab5b-1558a233e279 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:37.690683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 746/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:42:40.358497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf42d4-0bd8-410d-b968-c013b8864cb9 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:40.359966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf42d4-0bd8-410d-b968-c013b8864cb9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:40.359966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf42d4-0bd8-410d-b968-c013b8864cb9 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:40.361897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 745/1491] 10.222.0.48 () {54 vars in 926 bytes} [Tue May 10 16:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:42:40.370003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bc4-f404-4dd3-a0a7-370c450ba98e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:40.370835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bc4-f404-4dd3-a0a7-370c450ba98e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:40.371040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa585bc4-f404-4dd3-a0a7-370c450ba98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:40.396935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-fa585bc4-f404-4dd3-a0a7-370c450ba98e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:42:40.398607 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fa585bc4-f404-4dd3-a0a7-370c450ba98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:42:40.410851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 747/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Tue May 10 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:42:40.469567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf42d4-0bd8-410d-b968-c013b8864cb9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:42:40.480308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf42d4-0bd8-410d-b968-c013b8864cb9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:42:40.483904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:42:40.485107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:42:40.485389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:42:40.485665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:42:40.495303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:42:40.496803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203a066-91b0-4fee-ad2b-91b3248d47c2 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:42:40.507737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 746/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:11.523614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.524217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.524217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.543112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:11.544525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:11.559701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 748/1494] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:11.569743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.570254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.570450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.588199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:11.589424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:11.597956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 747/1495] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:11.602660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.612930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a582a-2ad3-4c5d-80e1-da77d6441e79 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.617462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.618121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.618406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.618682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.619411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:44:11.619722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.620779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.620779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:44:11.620779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:44:11.621663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.633188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 749/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:44:11.641882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.650866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f40f5-ed20-4d5a-9e1f-293e144a1363 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.656194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.656882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.657169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.657444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.658168 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.659946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.659946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:44:11.659946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:44:11.661194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.696113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 748/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:44:11 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:11.700719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.710230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9523e-179d-4e42-9378-31aa66cd049b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.764687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.765346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.765630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.765898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.766585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.767590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.767590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:44:11.767590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:44:11.768820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.788599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 750/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:44:11 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:44:11.792641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.803921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a339d6d-3a78-4b3d-a611-ce584d413c5d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.808468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.809158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.809451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.809729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.810467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.811521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.811521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:44:11.811521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:44:11.812441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.824858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 749/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:11.829004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.838643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d91ba6-e8e9-4d6e-a2b3-187cbfd0ac4c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.843945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.844625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.844911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.845187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.845909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.846913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.846913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:44:11.846913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:44:11.847804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5ab5e-f041-47fe-bf31-4dcf7df83df7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.861946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 751/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:44:11.866236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:11.875807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe048b-797c-4e2a-8254-3221990adb58 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:11.880217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:11.881111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.881388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.881659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] PATH_INFO: `/v3/projects/58b0db2c12c347d2b7164805e266373c/users/e53b5794380f4fed95f7e6059d3aceff/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.899759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b0db2c12c347d2b7164805e266373c, user_id=e53b5794380f4fed95f7e6059d3aceff, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:11.901558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:11.901558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:44:11.901558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:44:11.905516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a69af-ed9a-4beb-bfbf-77eeacf94518 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:11.918508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 750/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:44:11 2022] PUT /identity/v3/projects/58b0db2c12c347d2b7164805e266373c/users/e53b5794380f4fed95f7e6059d3aceff/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:11.930476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0a7b-10b9-4f82-977d-579ceaa02416 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:11.930773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0a7b-10b9-4f82-977d-579ceaa02416 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:11.931048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db0a7b-10b9-4f82-977d-579ceaa02416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:11.957731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-70db0a7b-10b9-4f82-977d-579ceaa02416 None None] MFA Rules not processed for user `e53b5794380f4fed95f7e6059d3aceff`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:11.958917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-70db0a7b-10b9-4f82-977d-579ceaa02416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:12.020488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 752/1502] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:12.034775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be938049-2b1c-4333-81c8-7b7400453963 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.035067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be938049-2b1c-4333-81c8-7b7400453963 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.035344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be938049-2b1c-4333-81c8-7b7400453963 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.036752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 751/1503] 10.222.0.48 () {54 vars in 963 bytes} [Tue May 10 16:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:44:12.041742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061035-5e4a-4946-82be-cc7f3ee3b91d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.041973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061035-5e4a-4946-82be-cc7f3ee3b91d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.042249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061035-5e4a-4946-82be-cc7f3ee3b91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.059998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-52061035-5e4a-4946-82be-cc7f3ee3b91d None None] MFA Rules not processed for user `df7219cea0ae464e8df960dd38906b01`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:12.061478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52061035-5e4a-4946-82be-cc7f3ee3b91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:12.110518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 753/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Tue May 10 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:12.117865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be938049-2b1c-4333-81c8-7b7400453963 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:12.128450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be938049-2b1c-4333-81c8-7b7400453963 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:12.131922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:12.132592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.132885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.133165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.141949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:12.143442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:12.151954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 752/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:44:12.194790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d8b5-7130-47e5-806c-1f6f3a69bca5 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.195076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d8b5-7130-47e5-806c-1f6f3a69bca5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.195350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d8b5-7130-47e5-806c-1f6f3a69bca5 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.196699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 754/1506] 10.222.0.48 () {52 vars in 829 bytes} [Tue May 10 16:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:44:12.200401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:12.260789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a3500-1f2c-4db3-ace8-179cc9c434e8 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:12.266904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:12.267769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.268054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.268359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] PATH_INFO: `/v3/users/e53b5794380f4fed95f7e6059d3aceff` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.269581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53b5794380f4fed95f7e6059d3aceff)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:12.270593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:12.270593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:44:12.270593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:44:12.271801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:12.333449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53b5794380f4fed95f7e6059d3aceff'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.351393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53b5794380f4fed95f7e6059d3aceff'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.352081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53b5794380f4fed95f7e6059d3aceff'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.352828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53b5794380f4fed95f7e6059d3aceff'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.364973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53b5794380f4fed95f7e6059d3aceff'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.380642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 753/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:44:12 2022] DELETE /identity/v3/users/e53b5794380f4fed95f7e6059d3aceff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:44:12.385006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.385291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.385564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.403771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:44:12.405173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:12.462096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 755/1508] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:44:12.471514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:12.472844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:12.530042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820c053-4e21-4465-a6ee-4d7ab2156a8d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:12.533631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:12.534280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.534569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.534849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.543953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:12.545455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280a0d9-9839-49c1-86cc-23393aa0dda5 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:12.554795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 754/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:44:12.897120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:44:12.898916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:44:12.911548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c801e2-4eed-4dac-8b28-2bf56a4cb334 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:44:12.916844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:44:12.917707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:44:12.917983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:44:12.918259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] PATH_INFO: `/v3/projects/58b0db2c12c347d2b7164805e266373c` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:44:12.919469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b0db2c12c347d2b7164805e266373c)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:44:12.921358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:44:12.921358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:44:12.921358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:44:12.922610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:44:12.980266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b0db2c12c347d2b7164805e266373c', 'request_id': 'req-36eb467c-9ced-4652-8330-2ebea84fdbf2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:12.994516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b0db2c12c347d2b7164805e266373c', 'request_id': 'req-36eb467c-9ced-4652-8330-2ebea84fdbf2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:13.005046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b0db2c12c347d2b7164805e266373c', 'request_id': 'req-36eb467c-9ced-4652-8330-2ebea84fdbf2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:13.015768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] The token cache is being invalidate because project 58b0db2c12c347d2b7164805e266373c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:44:13.016050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:13.016725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36eb467c-9ced-4652-8330-2ebea84fdbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:44:13.018443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 756/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:44:12 2022] DELETE /identity/v3/projects/58b0db2c12c347d2b7164805e266373c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:45:54.433807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.435186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.435503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.437009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:45:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:54.442653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202f6b-2313-4310-87d5-e6d6f72b398d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.443149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202f6b-2313-4310-87d5-e6d6f72b398d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.443253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202f6b-2313-4310-87d5-e6d6f72b398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.462395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c8202f6b-2313-4310-87d5-e6d6f72b398d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.463662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c8202f6b-2313-4310-87d5-e6d6f72b398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.527084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:54.708905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:54.710848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.729124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cafa19-0c57-48ac-b7fe-242d82458b10 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.729410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cafa19-0c57-48ac-b7fe-242d82458b10 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.729688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cafa19-0c57-48ac-b7fe-242d82458b10 None None] PATH_INFO: `/v3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.732307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 758/1513] 10.222.0.32 () {54 vars in 925 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:45:54.739755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b248d-aec6-46d4-8466-27951fa9cb34 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.740108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b248d-aec6-46d4-8466-27951fa9cb34 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.740441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b248d-aec6-46d4-8466-27951fa9cb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.759898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6e6b248d-aec6-46d4-8466-27951fa9cb34 None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:54.761200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6e6b248d-aec6-46d4-8466-27951fa9cb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:54.791652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaf66b-45e5-49aa-a767-a3c1b9f0c41d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:54.800137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:54.800843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:54.801130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:54.801654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:54.811227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:54.812909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfb652-1fc2-4c50-9ec4-a4998ff72fff service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:54.824352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 756/1514] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:54.831360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 759/1515] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 10 16:45:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:55.763355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815513b4-3021-4d12-a82d-3ea1ed5686a2 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.763938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815513b4-3021-4d12-a82d-3ea1ed5686a2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.763938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815513b4-3021-4d12-a82d-3ea1ed5686a2 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.765382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:55.771373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbf2-7b16-40ea-a3f7-6009b8f3e94a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:55.771853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbf2-7b16-40ea-a3f7-6009b8f3e94a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:55.771952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbf2-7b16-40ea-a3f7-6009b8f3e94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:55.920916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2f47dbf2-7b16-40ea-a3f7-6009b8f3e94a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:55.922145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2f47dbf2-7b16-40ea-a3f7-6009b8f3e94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:55.930322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:56.083534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815513b4-3021-4d12-a82d-3ea1ed5686a2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:56.097434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815513b4-3021-4d12-a82d-3ea1ed5686a2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:56.102665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:56.103294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:56.103571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:56.103842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:56.112135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:56.113762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27e95-b0a2-475c-a922-1c3192688d91 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:56.123439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 758/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:45:58.682604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4155ef5-c9d2-4228-9f47-619ec8631f05 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.683200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4155ef5-c9d2-4228-9f47-619ec8631f05 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.683372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4155ef5-c9d2-4228-9f47-619ec8631f05 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.684950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 761/1519] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 10 16:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:45:58.690648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780bc2-7d60-432c-bb03-c0d6b4d0b990 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.691251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780bc2-7d60-432c-bb03-c0d6b4d0b990 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.691251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54780bc2-7d60-432c-bb03-c0d6b4d0b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.713740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-54780bc2-7d60-432c-bb03-c0d6b4d0b990 None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:45:58.714976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-54780bc2-7d60-432c-bb03-c0d6b4d0b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:45:58.730526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 759/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 10 16:45:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:45:58.740159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4155ef5-c9d2-4228-9f47-619ec8631f05 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:45:58.754126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4155ef5-c9d2-4228-9f47-619ec8631f05 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:45:58.758998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:45:58.759654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:45:58.759933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:45:58.760202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:45:58.770255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:45:58.771878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc8e4-87e1-4525-9116-5b6438a846d9 service placement] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:45:58.783221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 762/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:45:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:07.468047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ccd8-349d-4e63-a287-48240335feb9 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.468660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ccd8-349d-4e63-a287-48240335feb9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.468660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ccd8-349d-4e63-a287-48240335feb9 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.470020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:07.475060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec0c-ab8d-4666-95fd-39aa12981d49 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.475542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec0c-ab8d-4666-95fd-39aa12981d49 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.475648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ec0c-ab8d-4666-95fd-39aa12981d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.493009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-3db7ec0c-ab8d-4666-95fd-39aa12981d49 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:07.494203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3db7ec0c-ab8d-4666-95fd-39aa12981d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:07.502594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:07.656935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ccd8-349d-4e63-a287-48240335feb9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:07.674619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ccd8-349d-4e63-a287-48240335feb9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:07.680306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:07.680944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:07.681229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:07.681507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:07.693002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:07.694584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e7cad-7056-48e2-a6f0-83a7c61eec0e service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:07.703772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 761/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:08.611145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938ca-9649-4f1d-b95d-cf7750b0d7d6 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.611736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938ca-9649-4f1d-b95d-cf7750b0d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.611736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938ca-9649-4f1d-b95d-cf7750b0d7d6 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.613083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 16:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:08.618111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8240b59-d07a-43bb-ab04-a83e19423081 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.618581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8240b59-d07a-43bb-ab04-a83e19423081 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.618713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8240b59-d07a-43bb-ab04-a83e19423081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.647185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e8240b59-d07a-43bb-ab04-a83e19423081 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:08.648487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e8240b59-d07a-43bb-ab04-a83e19423081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:08.656915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 16:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:08.811712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938ca-9649-4f1d-b95d-cf7750b0d7d6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:08.826532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938ca-9649-4f1d-b95d-cf7750b0d7d6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:08.831824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:08.832496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:08.832770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:08.833042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:08.842117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:08.843709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410da53-3e29-4bf6-8f62-7549eae306b1 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:08.853435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 765/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:13.421833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.422387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.422387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.423766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:13.429650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d59c0-aaa8-4f90-8de7-2765dd5e8c50 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.430144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d59c0-aaa8-4f90-8de7-2765dd5e8c50 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.430270 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d59c0-aaa8-4f90-8de7-2765dd5e8c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.449821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0a5d59c0-aaa8-4f90-8de7-2765dd5e8c50 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:13.451021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0a5d59c0-aaa8-4f90-8de7-2765dd5e8c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.458712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:13.496586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:13.498821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:13.572987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d61946-3af7-4bf5-81d1-4ba107b13d4d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:13.577503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:13.578177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:13.579227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:13.579227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:13.589254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:13.590997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71655f4-35ab-49af-b460-32dfaca0e70f service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:13.604568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 764/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:15.904239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315962ca-1d33-46bb-bbc6-4893028e36a1 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.904855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315962ca-1d33-46bb-bbc6-4893028e36a1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.904855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315962ca-1d33-46bb-bbc6-4893028e36a1 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.906181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:15.911379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee0fb-d5eb-4d5e-a022-c38e5ce6ae56 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.911828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee0fb-d5eb-4d5e-a022-c38e5ce6ae56 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.911927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee0fb-d5eb-4d5e-a022-c38e5ce6ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.929723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-032ee0fb-d5eb-4d5e-a022-c38e5ce6ae56 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:15.930893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-032ee0fb-d5eb-4d5e-a022-c38e5ce6ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:15.938569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:15.974071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315962ca-1d33-46bb-bbc6-4893028e36a1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:15.984465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315962ca-1d33-46bb-bbc6-4893028e36a1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:15.987948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:15.988592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:15.988875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:15.989144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:15.997693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:15.999104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca592c-64cb-48e2-aa0c-7a27ea1e80c9 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:16.008027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 768/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:19.995915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:19.996602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:19.996602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:19.997904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:20.003521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702e1e4-8900-459d-9fff-92b8562e3ee2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.003983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702e1e4-8900-459d-9fff-92b8562e3ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.004098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702e1e4-8900-459d-9fff-92b8562e3ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.023190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c702e1e4-8900-459d-9fff-92b8562e3ee2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:20.024415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c702e1e4-8900-459d-9fff-92b8562e3ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.033159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:20.310699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:20.312384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:20.369902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fc9ee-8bc1-4f9f-87f0-a602d6773410 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:20.374233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:20.374967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:20.375246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:20.375515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:20.385571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:20.387497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95fa7a-93aa-4e20-9922-70a2a62b68a3 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:20.397136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 767/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:46:22.724602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.725135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.725135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.726451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 16:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:46:22.732649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774cdf-634e-48bf-b0f1-a2c4a11b5edd None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:22.733068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774cdf-634e-48bf-b0f1-a2c4a11b5edd None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:22.733198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774cdf-634e-48bf-b0f1-a2c4a11b5edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:22.751584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3f774cdf-634e-48bf-b0f1-a2c4a11b5edd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:46:22.752920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3f774cdf-634e-48bf-b0f1-a2c4a11b5edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:22.760641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 16:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:46:23.037332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:46:23.038999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:46:23.053224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65d13-fad3-4a56-97fc-96ef7bee2da3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:46:23.056797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:46:23.057459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:46:23.057742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:46:23.058064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:46:23.067404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:46:23.068857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bcda6-b3e8-45cf-be35-0902c99e1984 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:46:23.078565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 771/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:56.614056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.615076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.615657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.656972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:56.661420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:56.673275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 769/1540] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:56.685304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.685919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.685919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.722212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:56.723410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:56.739158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 772/1541] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:47:56.748239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:56.765230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3956-9c57-40ab-9a5f-a64f72f458d4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:56.770302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:56.771226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.771742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.772228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.773198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:56.773732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:56.775046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:47:56.775046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:47:56.775046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:47:56.778122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:56.792159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 770/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:56.800068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:56.814675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74a065-01b3-4419-a721-0dc0678f2989 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:56.822658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:56.823339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.823626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.823899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.824638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:56.825663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:47:56.825663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:47:56.825663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:47:56.827418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:56.868908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 773/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:56 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:56.873167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:56.887749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d5a53-3d28-4f2e-b263-6ca34104df87 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:56.952551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:56.953624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:56.954272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:56.954773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:56.955690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:56.956950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:47:56.956950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:47:56.956950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:47:56.958565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:56.988107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 771/1544] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:56 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:56.992482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.007300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea7160-3479-468a-9926-5627cc16b8f3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.015871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.016606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.016956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.017411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.018470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.020681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.038282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 774/1545] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:57.042896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.059035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a365b15-a6c2-42bf-addf-386997413264 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.069079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.070194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.070691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.071871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.072867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.074746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34bb601-c550-4d1d-98a8-8bd4e9c66ac8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.087538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 772/1546] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:47:57.091517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.108936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54bed8-3c51-42c6-ab9a-0a02770e4986 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.116022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851242-4385-4518-b484-8a011955b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.117545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851242-4385-4518-b484-8a011955b881 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.118682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851242-4385-4518-b484-8a011955b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.118972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851242-4385-4518-b484-8a011955b881 admin admin] PATH_INFO: `/v3/projects/f6208c73932343aeae12d8cd0983fc77/users/4de0f4da2d2e464fb9501fa58e344bed/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.140450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851242-4385-4518-b484-8a011955b881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6208c73932343aeae12d8cd0983fc77, user_id=4de0f4da2d2e464fb9501fa58e344bed, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.141522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-72851242-4385-4518-b484-8a011955b881 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:47:57.141522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:47:57.141522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:47:57.143469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851242-4385-4518-b484-8a011955b881 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.162871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 775/1547] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:57 2022] PUT /identity/v3/projects/f6208c73932343aeae12d8cd0983fc77/users/4de0f4da2d2e464fb9501fa58e344bed/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:57.168791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e8ea-01e4-44a6-865f-763f7e533b5f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.170056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e8ea-01e4-44a6-865f-763f7e533b5f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.170729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e8ea-01e4-44a6-865f-763f7e533b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.196218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-2a26e8ea-01e4-44a6-865f-763f7e533b5f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.198027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2a26e8ea-01e4-44a6-865f-763f7e533b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.273119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 773/1548] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.294229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851242-4385-4518-b484-8a011955b881 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.297412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-72851242-4385-4518-b484-8a011955b881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.310662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f7f4-015b-4cd7-be40-64532c7856d2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.311598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f7f4-015b-4cd7-be40-64532c7856d2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.312094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836f7f4-015b-4cd7-be40-64532c7856d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.344384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5836f7f4-015b-4cd7-be40-64532c7856d2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.347379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5836f7f4-015b-4cd7-be40-64532c7856d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.358633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.370222 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.371021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.371505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.402599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.408798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.420193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 775/1550] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.425591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851242-4385-4518-b484-8a011955b881 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.427149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.434936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.435999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.436528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.437012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.453794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68178fe-7e68-4d84-b00b-9eec713e22b5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.460785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.464126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5043b4-a5d5-4e90-b3cb-9ee9fd344983 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.469124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.470091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.474118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.474639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.475606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:57.476126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.478019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd8805-4c88-44be-99d4-5f5ad07587b8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.490080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 776/1551] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:47:57.491936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.492491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.493602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.521307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.522861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.541780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 777/1552] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.542416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 776/1553] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:47:57.544119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd5a7-4aff-4909-ae2c-da14ed57ab6d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.544912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd5a7-4aff-4909-ae2c-da14ed57ab6d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.545506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd5a7-4aff-4909-ae2c-da14ed57ab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.548878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.574833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a386e-e5b8-4763-8ea9-97284e17273c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.589937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5d3fd5a7-4aff-4909-ae2c-da14ed57ab6d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.591558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5d3fd5a7-4aff-4909-ae2c-da14ed57ab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.609113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.609789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.610078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.610370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.611182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.612536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 777/1554] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.613712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49089a-785a-40b6-82a8-b03422301ed4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.614688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d3c0-85da-4063-87bb-f37d4cdfee62 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.615673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d3c0-85da-4063-87bb-f37d4cdfee62 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.616162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d3c0-85da-4063-87bb-f37d4cdfee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.661431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9696d3c0-85da-4063-87bb-f37d4cdfee62 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.663084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9696d3c0-85da-4063-87bb-f37d4cdfee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.683338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 778/1555] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.685169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c7054-e453-40d0-a68c-6561cbe22e3d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.688471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c7054-e453-40d0-a68c-6561cbe22e3d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.689074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c7054-e453-40d0-a68c-6561cbe22e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.720375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0d5c7054-e453-40d0-a68c-6561cbe22e3d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.721172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 778/1556] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:57.723153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.724709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0d5c7054-e453-40d0-a68c-6561cbe22e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.725256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.725741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.770800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.772095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.817163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 779/1557] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.821990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc070-0be5-49a5-a96e-b5bc042470e7 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.823048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc070-0be5-49a5-a96e-b5bc042470e7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.823555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bc070-0be5-49a5-a96e-b5bc042470e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.847233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c92bc070-0be5-49a5-a96e-b5bc042470e7 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.849536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c92bc070-0be5-49a5-a96e-b5bc042470e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.862114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 780/1558] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.868313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1cfd-515f-4442-88ec-4477c22c2609 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.868947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1cfd-515f-4442-88ec-4477c22c2609 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.869489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f1cfd-515f-4442-88ec-4477c22c2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.892350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 779/1559] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.893699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-090f1cfd-515f-4442-88ec-4477c22c2609 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.895300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.896967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-090f1cfd-515f-4442-88ec-4477c22c2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.913218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da03b9-3410-4dd9-9740-8031cbc07eed None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.913821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 781/1560] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.915323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.915683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.916030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.922077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.924085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.924769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.925260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.926568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.929433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125379-0d14-4cb9-991f-ce500c4ac6dd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.934519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.935848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.946602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 782/1561] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:57.947614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.955506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 780/1562] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:57.957151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69608b-cdaf-4175-a8be-77c6888b1941 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.957455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69608b-cdaf-4175-a8be-77c6888b1941 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.957724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69608b-cdaf-4175-a8be-77c6888b1941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.962888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1a857-6df6-4600-ab15-5020c02e3cf9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:57.968634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:57.969136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:57.969425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:57.969737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:57.970453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:57.970751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:57.972432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:57.985463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-df69608b-cdaf-4175-a8be-77c6888b1941 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:57.993975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 783/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:57.993975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:57.994257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-df69608b-cdaf-4175-a8be-77c6888b1941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:57.998929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 781/1564] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:58.000662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2d3-6109-4206-8da3-d669e7243688 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.000996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2d3-6109-4206-8da3-d669e7243688 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.001252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2d3-6109-4206-8da3-d669e7243688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.003850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747b9e0-b82e-43f8-9fab-8be86c5fe1ee admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.009798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.010471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.010749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.011023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.012254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:58.012596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.014377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.023602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-69fcc2d3-6109-4206-8da3-d669e7243688 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:58.025009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-69fcc2d3-6109-4206-8da3-d669e7243688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:58.026516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 784/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:58.027503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.037586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10cf6f-83d3-423c-8828-f88763fd5b8d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.040140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 782/1566] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:58.041985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.042411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.042831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.056129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.057598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.057598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.057598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.058717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:58.058717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.060569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.070935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:58.072906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:58.078336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 785/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:58.087863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.099385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 783/1568] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:58.100343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.109654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97407b-4f86-4582-9c95-d704b09d88d3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.112842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cae06b-371c-49a3-8310-ea584954c00a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.118150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.118612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.118805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.119083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.119351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.119890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.120160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.120422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.120948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.122203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.122324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.125217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.149837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 786/1569] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:58.151538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.157361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 784/1570] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.157856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.170801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857b7a8-26ef-4314-809f-e50055e6a160 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.241834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.243043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.243419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.243699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.244468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:58.244777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.246135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fb86-27c1-4dbe-8db3-201691fd128c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.246395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c88bc-235e-4c3a-b9ce-a10deda3041b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.252343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.253106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.253981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.254383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.255796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.258606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.259091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 787/1571] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:58.261308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.261603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.261886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.285049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:58.286552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:58.300010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 788/1572] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:58.300010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.303625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 785/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.305754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.309906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635d0a-190e-49c6-b6fa-131e6420f0b5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.371873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.372501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.372794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.373074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.373733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9950b98-e3bc-409d-a87d-e8d3feb1dc42 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.373865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.375725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.378753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.379511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.379863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.380454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.381058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:58.381433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.383261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.395515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 786/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:58.398108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.410787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 789/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.411716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.419557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308051d-c475-4900-8c3f-a8a79f7473a4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.482843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95250d-4a8c-438b-a4e6-ca5695a223c6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.487994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.488813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.489096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.489379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.490081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.490347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.491345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.491501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.491653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.492034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.492403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.494188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.508117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 787/1576] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:58.510101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.521644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 790/1577] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.522663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.528672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f28e-d522-45f7-b07c-0c3f10f945f7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.535799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3d1bb-1b77-45dd-a249-850bd9ee21df admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.540421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.541466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.541762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.542040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.542885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.543201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.544314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.544700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.544834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.545379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.547139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:47:58.547559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.549502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.574733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 791/1578] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:47:58.575761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.589506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2017679-184a-4047-acca-0fd1c640eb7a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.594370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 788/1579] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 403 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.596440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.600822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.601510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.601799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.602144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.603735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.608320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.642461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 792/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.643307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.657670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7ebea-6f34-4d50-aaa2-3d08ba03bb63 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.687909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620662f-2891-4641-bd0c-fbb803f9d083 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.693091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.696438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.697098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.698019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.698780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.701190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.721953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.722646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.722939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.723268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.723974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.726011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.739960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 789/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.740934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.759338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 793/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:58.760553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.772152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64671784-bd0f-4d77-8421-1013785e08b4 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.810961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa9812-ae59-4c44-85d8-4319d98447b8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.816726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.817680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.818057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.818391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] PATH_INFO: `/v3/projects/8e5268ab3fcf4ec1a112f8e76dbeccd7/users/2d53bca1bae04b9c973fee7f05a2648b/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.834863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5268ab3fcf4ec1a112f8e76dbeccd7, user_id=2d53bca1bae04b9c973fee7f05a2648b, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.838354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.839192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.840560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.841075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.841533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.842812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.844842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.864125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 790/1583] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:58 2022] PUT /identity/v3/projects/8e5268ab3fcf4ec1a112f8e76dbeccd7/users/2d53bca1bae04b9c973fee7f05a2648b/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:58.864125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.877103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 794/1584] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:58.878866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:58.891850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdce87-1b6e-4dbf-b9fd-8c3123a99517 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.946304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f07d7-6b2f-4235-a33c-6d39986cf18b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:58.951458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.952143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.952472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.952745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.953495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.955413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:58.985674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:58.986380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:58.986652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:58.986952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:58.987634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:58.989981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.000327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 791/1585] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:59.001791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.021822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 795/1586] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:58 2022] POST /identity/v3/users => generated 302 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:59.021822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.048981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d136-bede-497e-85a5-94d7e5f07936 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.122887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a562ac-0ea2-4119-aa7c-44ff169ca0cd admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.129829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.130347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.130804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.131092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.131422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.131955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.132162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.132569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.133047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.134396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.134870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.137296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b9e63-28ed-4af2-9271-91d512c7f476 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.152363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 792/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.153952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.172846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 796/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:59.174309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.174598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.174878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.177633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fb760-c6b2-4e63-908a-7f4765a4586c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.185255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.185701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.186087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.186461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.187865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.189794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.204194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 793/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.208100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.219703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bd830-7364-4319-9aa0-689577f322f9 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.223290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] MFA Rules not processed for user `2d53bca1bae04b9c973fee7f05a2648b`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:59.224561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:59.236381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.237371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.237814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.238245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.239255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.241102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.258903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 794/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.258903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.273425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3731-b848-4c81-b371-3208441de994 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.281060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.281741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.282157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.282437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.283135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.285111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.308879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 797/1591] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:59.313396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.317164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 795/1592] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:47:59.317164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.326358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f406a6d-842c-4649-a993-5de281ad62b1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.333227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.334712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.335263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.336191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.336484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c579-1dd1-475d-8277-f9d08a742c23 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.337291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.339446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.342723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.343525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.343895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.344236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.345236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.346922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.360859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 798/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.360859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.364518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 796/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.364518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.372413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b0fdf-a1f5-402c-bfd5-31fc776b272f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.379007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.380553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.381203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.381385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.382716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.385149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de7cf7-ac2d-4019-91fa-2e79c02b638b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.385979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.392711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.394061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.394390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.394662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.395401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.397146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.400940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 799/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.400940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.409959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 797/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.411673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.415052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ca3cb-a13b-463f-b17e-deb55c7b4e3f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.422815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.425232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86d4a-8916-408d-9259-0f965327e96e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.426524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.426910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.427285 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] PATH_INFO: `/v3/projects/8fa7e630b7904478a842fc3c4509dbf6/users/1e056acdbda44e4c92ccc050d8161c2a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.444962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.446326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.446714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.447090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.448067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.449889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f702-0091-458c-97ae-1791d7cef594 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.463265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa7e630b7904478a842fc3c4509dbf6, user_id=1e056acdbda44e4c92ccc050d8161c2a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.466566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.470040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 798/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.471721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add0b9-8177-47c0-8bd3-f16f5f3e40a7 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.472050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add0b9-8177-47c0-8bd3-f16f5f3e40a7 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.472493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add0b9-8177-47c0-8bd3-f16f5f3e40a7 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.474116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 799/1598] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 10 16:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:47:59.475517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add0b9-8177-47c0-8bd3-f16f5f3e40a7 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.492114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add0b9-8177-47c0-8bd3-f16f5f3e40a7 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.494801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 800/1599] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:59 2022] PUT /identity/v3/projects/8fa7e630b7904478a842fc3c4509dbf6/users/1e056acdbda44e4c92ccc050d8161c2a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:59.496030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.591945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6dba9-0339-46f9-8f0e-79a4a0f2a2f7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.600130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.601287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.601664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.602028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] PATH_INFO: `/v3/projects/6c526b65f8454d7e84b29236f42417f7/users/e2a00f1a578d44abadaa39db5235363a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.606343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.607474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.607856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.608411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.609657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.611391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.624245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 800/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.625300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.632336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c526b65f8454d7e84b29236f42417f7, user_id=e2a00f1a578d44abadaa39db5235363a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.636112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.640075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfca79f-6b38-4b5c-9481-614fd7086ec1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.646122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.646811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.647101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.647379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.648121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.651148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 801/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:59 2022] PUT /identity/v3/projects/6c526b65f8454d7e84b29236f42417f7/users/e2a00f1a578d44abadaa39db5235363a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:59.652320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.656771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.668484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 801/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.669564 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.684461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced88a7-58f4-4d27-bff6-6c669033f03e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.740069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fad3e3-ddf6-4e52-8556-a985a1255d1b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:47:59.750045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.751410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.751992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.752307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] PATH_INFO: `/v3/projects/a26f2126d1804c3caf0f83a1eb47fbff/users/25229d5ef3be47988accfdee5f9209b8/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.756535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:47:59.757441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.757961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.758398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.759630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.762456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9013119-3426-487c-aa91-f3688e5f023f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.782264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26f2126d1804c3caf0f83a1eb47fbff, user_id=25229d5ef3be47988accfdee5f9209b8, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:47:59.785367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed20c0e-2d5f-4e61-b449-412c3fdf3aab admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:47:59.791258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 802/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:47:59.791258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.791258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.791258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.814187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 802/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:59 2022] PUT /identity/v3/projects/a26f2126d1804c3caf0f83a1eb47fbff/users/25229d5ef3be47988accfdee5f9209b8/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:47:59.814490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:59.815700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:59.819188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b208-c3c5-41df-87fc-31a40d9e314c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.819480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b208-c3c5-41df-87fc-31a40d9e314c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.819758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57b208-c3c5-41df-87fc-31a40d9e314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.869303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4b57b208-c3c5-41df-87fc-31a40d9e314c None None] MFA Rules not processed for user `1e056acdbda44e4c92ccc050d8161c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:59.870563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4b57b208-c3c5-41df-87fc-31a40d9e314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:47:59.934109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 803/1605] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:59.935108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:47:59.962335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 803/1606] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:47:59.962335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:47:59.962335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:47:59.962335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:47:59.982154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:47:59.983383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:00.015932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eaf9c-585a-4b91-8422-4addc21b10e0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.022228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.023137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.023485 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.023889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] PATH_INFO: `/v3/projects/9df655e0767f4fc0a42b13808f15e843/users/d98439c4e0a7406f8be9058570e01687/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.051474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df655e0767f4fc0a42b13808f15e843, user_id=d98439c4e0a7406f8be9058570e01687, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.054736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.068587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 804/1607] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:00.068587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.076484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 804/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:47:59 2022] PUT /identity/v3/projects/9df655e0767f4fc0a42b13808f15e843/users/d98439c4e0a7406f8be9058570e01687/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:00.077613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.084557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a8270-4a19-48fd-96d1-825a724a1a50 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.148360 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a009393-9b8a-4ac2-8bad-65c3db60900d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.154436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.155762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.155762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.156021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] PATH_INFO: `/v3/projects/60f85e7bbb38404ba6b68eff605a3306/users/f4fabe073e2f4fa1bfb6c5fbaf859eac/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.167757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.168696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.168993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.169439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] PATH_INFO: `/v3/projects/a7ec0c457e5a4982bb33d621335966eb/users/ae60f3c4e1df468cb5404739503c5f22/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.176782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f85e7bbb38404ba6b68eff605a3306, user_id=f4fabe073e2f4fa1bfb6c5fbaf859eac, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.185260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1d6a2-f7e0-4d79-bbc2-28fe9e3cfcec admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.192819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ec0c457e5a4982bb33d621335966eb, user_id=ae60f3c4e1df468cb5404739503c5f22, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.196208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.200476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 805/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:00 2022] PUT /identity/v3/projects/60f85e7bbb38404ba6b68eff605a3306/users/f4fabe073e2f4fa1bfb6c5fbaf859eac/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:00.202888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.203198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.204268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.223917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:00.225037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:00.225721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 805/1610] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:00 2022] PUT /identity/v3/projects/a7ec0c457e5a4982bb33d621335966eb/users/ae60f3c4e1df468cb5404739503c5f22/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:00.237611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.293015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 806/1611] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:00.294461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.304680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab4537-64fc-4256-8120-6ab52969b846 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.310184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.310844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.311123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.311398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.312086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.314097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.325978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53b45-3a74-40a0-9507-a55b664cfe07 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.333026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.333734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.333995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.334284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.343441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 807/1612] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:00.347800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.422163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9acc54-812f-4d59-84f0-e4fbfaa7ff1b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.423685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.425738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207d471-959a-487e-8197-c1b9da333bf9 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.426636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.427326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.427614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.428918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.443767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 806/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:00.473158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdbc9-e5ad-4119-ba1d-8cba10dc9608 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.473464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdbc9-e5ad-4119-ba1d-8cba10dc9608 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.477549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fdbc9-e5ad-4119-ba1d-8cba10dc9608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.512082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a21fdbc9-e5ad-4119-ba1d-8cba10dc9608 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:00.513472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a21fdbc9-e5ad-4119-ba1d-8cba10dc9608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:00.519769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.522015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9a77-3769-4fea-b3fb-873e5cf9b607 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.522975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 807/1614] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:00.524687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.524831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.525070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.539240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 808/1615] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:00.541383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.542087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.542438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.548405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:00.550076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:00.564566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 808/1616] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:00.569994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.584247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] MFA Rules not processed for user `ae60f3c4e1df468cb5404739503c5f22`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:00.585777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:00.590091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dad763-6d46-4bb5-88e2-4d0d6e96f325 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.633785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.634474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.634760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.635047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.662769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.665120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.688258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 809/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:00.692852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.710844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d906b4f-0b07-48be-a176-476956b5b02b service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.733435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.734154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.734452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.734733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.735555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.737898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.782717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 809/1618] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:00.784251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.790510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 810/1619] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:00.793579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.802620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e43c83-370a-4790-a18d-2a472a560b60 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.813176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.814112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.814971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.815405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.830883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.832800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.840776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb76c6a-7be1-4a0b-89a9-e2f328dbe927 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.868416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.869432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.869599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 810/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:00.870232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.870655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.876708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.897357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.899795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.909931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810121a2-22a9-48ed-94c6-9359899ce49d service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.914834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 811/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:00.916116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:00.929784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.931370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.931690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.931970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.932728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.936085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.939939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68506e-595d-450e-9c8c-54f3dab8408d service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:00.957131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:00.958885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:00.959203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:00.959487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:00.960768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:00.962511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:00.989981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 812/1622] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:01.003616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.005666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 811/1623] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:00 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:01.006716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.034041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c39ecb-d76c-46d7-af2f-a65d5897ff25 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.080171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf07d18-bbdf-435c-9531-bef495eb72af admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.085710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.087056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.087362 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.087645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.088640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.090752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bdc3c-b794-4cff-953f-3dbaa7ae8da6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.118495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 812/1624] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:01 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:01.120856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544797-0fb0-4c6e-b9f9-5b9eab2ba41b None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.120856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544797-0fb0-4c6e-b9f9-5b9eab2ba41b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.120856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a544797-0fb0-4c6e-b9f9-5b9eab2ba41b None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.122604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 813/1625] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 10 16:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:01.123372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544797-0fb0-4c6e-b9f9-5b9eab2ba41b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.140512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a544797-0fb0-4c6e-b9f9-5b9eab2ba41b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.153868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.154764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.155051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.155460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.158274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.161684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532fb24-8588-4232-88b6-857b3f7c7875 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.177381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.179485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.180591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.180876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] PATH_INFO: `/v3/projects/9197cd1f221b4683add225ecac919773/users/a308ae5914064ded8eac48282c319e80/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.191475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 814/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:01.201014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.201767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.203317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.224003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9197cd1f221b4683add225ecac919773, user_id=a308ae5914064ded8eac48282c319e80, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.230331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.249337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:01.253386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:01.260413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 813/1627] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:01 2022] PUT /identity/v3/projects/9197cd1f221b4683add225ecac919773/users/a308ae5914064ded8eac48282c319e80/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:01.261386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.425476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0e82b-6122-48a5-8b55-4b141ab1ffad admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.439690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 815/1628] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:01.441627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.445308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.447166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.447461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.447748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] PATH_INFO: `/v3/projects/5039b93440a34759a1367f88d6ef415b/users/a6c88d0a49e14565bd122d27f06241d1/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.468659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e4985-493b-45df-b117-0f7285b3465c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.483584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.484729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.485235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.486613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.489986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.498412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.502664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5039b93440a34759a1367f88d6ef415b, user_id=a6c88d0a49e14565bd122d27f06241d1, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.507620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.549852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 814/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:01 2022] PUT /identity/v3/projects/5039b93440a34759a1367f88d6ef415b/users/a6c88d0a49e14565bd122d27f06241d1/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:01.553799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.555552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 816/1630] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:01.563948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.599550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995c7ad-b424-488c-a2b4-03b69545aa01 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.715840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7151a0-737c-4ec2-a6e3-377c80342bee admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.721420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.722702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.723177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.723630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.746011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.746978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.747269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.747544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] PATH_INFO: `/v3/projects/9197cd1f221b4683add225ecac919773/users/a308ae5914064ded8eac48282c319e80/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.753004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9197cd1f221b4683add225ecac919773, user_id=a308ae5914064ded8eac48282c319e80, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.756069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.781909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 817/1631] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:01 2022] PUT /identity/v3/projects/9197cd1f221b4683add225ecac919773/users/a308ae5914064ded8eac48282c319e80/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:01.782868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:01.839906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.841475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e90e5-367c-4801-98c7-0175f51f5b99 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:01.878819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 815/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:01.882408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.882907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.883813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.955411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1cdd-a5ae-4af5-91de-90cde39e8723 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:01.967298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] MFA Rules not processed for user `a308ae5914064ded8eac48282c319e80`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:01.969653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:01.970494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:01.971371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:01.971662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:01.971821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:01.973672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:01.978012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:02.017411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 818/1633] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:02.022279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:02.052860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c115a6e-f224-431f-a99a-8fd8b1fc943c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:02.065951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:02.066865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:02.067154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:02.068068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] PATH_INFO: `/v3/projects/5039b93440a34759a1367f88d6ef415b/users/a6c88d0a49e14565bd122d27f06241d1/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:02.074044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5039b93440a34759a1367f88d6ef415b, user_id=a6c88d0a49e14565bd122d27f06241d1, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:02.079212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375ffa7-f254-4823-9f87-16e957f41406 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:02.103730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 819/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:02 2022] PUT /identity/v3/projects/5039b93440a34759a1367f88d6ef415b/users/a6c88d0a49e14565bd122d27f06241d1/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:02.107482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:02.107868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:02.108118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:02.217017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] MFA Rules not processed for user `a6c88d0a49e14565bd122d27f06241d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:02.219382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 816/1635] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:02.230091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:02.235238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:02.429719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644e71-4a6e-47e9-80c2-54e466848df5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:02.557115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 820/1636] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:02.595574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:02.597466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:02.598266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:02.599385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:02.771165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:02.784268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:02.811952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 817/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:02.888497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:02.902359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fcdc6a-0c2f-4399-89af-16a0f15155e0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:02.911942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:02.912933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:02.915992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:02.916468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:03.121906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:03.126059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db9123-79a8-409b-bc3d-0109a4813bbd service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:03.143853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 821/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:03.486905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:03.507250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d18a2-9480-44b2-9ede-43e9f7a68de7 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:03.525280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:03.525967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:03.526253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:03.526535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:03.703452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:03.707882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efe40e-ed25-4319-9bb9-717215162fff service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:03.732348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 818/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:04.190179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd79c8-74ac-42c1-a1b4-264687ac186a None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.191035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd79c8-74ac-42c1-a1b4-264687ac186a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.191035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd79c8-74ac-42c1-a1b4-264687ac186a None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.192145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 822/1640] 10.222.0.48 () {54 vars in 961 bytes} [Tue May 10 16:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:48:04.208591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6097bd-e5cf-4f2b-99da-07b573b08290 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.209538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6097bd-e5cf-4f2b-99da-07b573b08290 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.209990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6097bd-e5cf-4f2b-99da-07b573b08290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.254692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ec6097bd-e5cf-4f2b-99da-07b573b08290 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.255727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ec6097bd-e5cf-4f2b-99da-07b573b08290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.269442 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3216f-7a80-4035-972e-ca460ab51767 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.270069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3216f-7a80-4035-972e-ca460ab51767 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.270558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3216f-7a80-4035-972e-ca460ab51767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.327210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-daa3216f-7a80-4035-972e-ca460ab51767 None None] MFA Rules not processed for user `d98439c4e0a7406f8be9058570e01687`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.328887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-daa3216f-7a80-4035-972e-ca460ab51767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.548835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 819/1641] 10.222.0.48 () {58 vars in 1058 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:04.550794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f31e8e-4c73-4920-948f-28eb37d7bb26 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.551609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f31e8e-4c73-4920-948f-28eb37d7bb26 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.552111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f31e8e-4c73-4920-948f-28eb37d7bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.562535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 823/1642] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.564078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0224-6904-45ec-9ee0-a7dff1b87519 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.564404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0224-6904-45ec-9ee0-a7dff1b87519 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.564687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa0224-6904-45ec-9ee0-a7dff1b87519 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.566440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 824/1643] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 10 16:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:04.567293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa0224-6904-45ec-9ee0-a7dff1b87519 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.599289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-44f31e8e-4c73-4920-948f-28eb37d7bb26 None None] MFA Rules not processed for user `f4fabe073e2f4fa1bfb6c5fbaf859eac`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.601085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-44f31e8e-4c73-4920-948f-28eb37d7bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.731082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 820/1644] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.733341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db33e6-0f3f-42c9-9b59-a0a0ae124f58 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.734087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db33e6-0f3f-42c9-9b59-a0a0ae124f58 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.734549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db33e6-0f3f-42c9-9b59-a0a0ae124f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.745483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa0224-6904-45ec-9ee0-a7dff1b87519 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.753271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.754259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.754735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.755164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.756501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:04.758820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:04.762346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e6db33e6-0f3f-42c9-9b59-a0a0ae124f58 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.764322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e6db33e6-0f3f-42c9-9b59-a0a0ae124f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.785516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 821/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.790328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.790563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.790918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.817688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] MFA Rules not processed for user `f4fabe073e2f4fa1bfb6c5fbaf859eac`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:04.818931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:04.829441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 825/1646] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:04.831163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.838422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 822/1647] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:04.838422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:04.855693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56602c2-f063-4c8c-ac81-b3fe38bf3b48 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.962058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ba2a6-004b-4b9c-8e07-b07eed47b1fc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:04.978359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.981721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.982183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:04.983210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.983782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:04.984343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.984889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:04.986227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:04.990776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.003639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.070663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 823/1648] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:04 2022] POST /identity/v3/users => generated 309 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:05.074630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:05.222917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.230233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.278904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 826/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:05.281312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:05.319263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822d37-ff81-4e69-8407-508b363fbe9f service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.321498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d349-73c9-4c84-a8a3-ef3c71fb1d7d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.334873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.341433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.343473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.344749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.345982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.347196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.348139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.349134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.350111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.352995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.387666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 827/1650] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:05.396694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:05.409080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3b37-fce0-415e-b704-97fb4e80af3f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.416071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.417252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.417899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.418478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] PATH_INFO: `/v3/projects/3df51ca5b09b40378055260f8bd5e9da/users/e39433bfc6fb486686b4f6032192ddec/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.437653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df51ca5b09b40378055260f8bd5e9da, user_id=e39433bfc6fb486686b4f6032192ddec, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.440909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.464797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 828/1651] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:05 2022] PUT /identity/v3/projects/3df51ca5b09b40378055260f8bd5e9da/users/e39433bfc6fb486686b4f6032192ddec/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:05.471365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:05.541986 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.545490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.599970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 824/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:05.820342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867618e-f260-4774-acb6-4df87c3f7968 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.842077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.842772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.843720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.843720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.844066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.854835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae444f2-ead7-4a8a-93a1-4ff5342996af admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:05.893737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:05.903856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 829/1653] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:05.919419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22232af-fe0e-4165-9131-7e0b4e7ab5b6 service nova] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:05.939534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:05.941211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:05.941389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:05.941721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] PATH_INFO: `/v3/projects/3df51ca5b09b40378055260f8bd5e9da/users/e39433bfc6fb486686b4f6032192ddec/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:05.948232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df51ca5b09b40378055260f8bd5e9da, user_id=e39433bfc6fb486686b4f6032192ddec, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:05.957034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff9b0-6eea-4744-9e6d-ea7ad4db36ae admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:06.000479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 825/1654] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:05 2022] PUT /identity/v3/projects/3df51ca5b09b40378055260f8bd5e9da/users/e39433bfc6fb486686b4f6032192ddec/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:06.581746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32664d-e7a7-40b9-85e3-a060a188fe03 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:06.584049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32664d-e7a7-40b9-85e3-a060a188fe03 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:06.584637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32664d-e7a7-40b9-85e3-a060a188fe03 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:06.588857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 830/1655] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 10 16:48:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:06.597028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a88f6-9fc4-4c52-bdda-a0e7cc111767 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:06.597671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a88f6-9fc4-4c52-bdda-a0e7cc111767 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:06.597852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a88f6-9fc4-4c52-bdda-a0e7cc111767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:06.693188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-713a88f6-9fc4-4c52-bdda-a0e7cc111767 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:06.695018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-713a88f6-9fc4-4c52-bdda-a0e7cc111767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:06.808773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 826/1656] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:48:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:06.865490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32664d-e7a7-40b9-85e3-a060a188fe03 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:06.897698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32664d-e7a7-40b9-85e3-a060a188fe03 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:06.910601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:06.911284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:06.911578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:06.911867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:06.961815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:06.961815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdab20-f809-4e21-acfa-42afd17153ca service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:06.978069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 831/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:08.102701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861cb0-ffc3-4e32-bdb8-39b94254fec8 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:08.103241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861cb0-ffc3-4e32-bdb8-39b94254fec8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:08.103241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861cb0-ffc3-4e32-bdb8-39b94254fec8 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:08.104684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 827/1658] 10.222.0.48 () {54 vars in 960 bytes} [Tue May 10 16:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:08.111680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e826-ce80-4d89-be1a-b54dab29f164 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:08.112595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e826-ce80-4d89-be1a-b54dab29f164 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:08.113010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e826-ce80-4d89-be1a-b54dab29f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:08.149112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f5e4e826-ce80-4d89-be1a-b54dab29f164 None None] MFA Rules not processed for user `bba8591023ac48f6af78ecb039dabb33`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:08.152098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f5e4e826-ce80-4d89-be1a-b54dab29f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:08.342764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 832/1659] 10.222.0.48 () {58 vars in 1057 bytes} [Tue May 10 16:48:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:08.350555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34861cb0-ffc3-4e32-bdb8-39b94254fec8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:08.375240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34861cb0-ffc3-4e32-bdb8-39b94254fec8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:08.391352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:08.392027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:08.392331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:08.392614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:08.394456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:08.420363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:08.422013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02860e5-d574-468b-9449-2aed9760e0ff service placement] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:08.443016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 828/1660] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:09.354376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae83f56-62a1-423b-b7cd-25cb270c7f57 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:09.355619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae83f56-62a1-423b-b7cd-25cb270c7f57 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:09.356886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae83f56-62a1-423b-b7cd-25cb270c7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:09.403147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1ae83f56-62a1-423b-b7cd-25cb270c7f57 None None] MFA Rules not processed for user `e39433bfc6fb486686b4f6032192ddec`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:09.404597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1ae83f56-62a1-423b-b7cd-25cb270c7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:09.499720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 833/1661] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:09.683795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:09.684257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:09.684439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:09.741961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] MFA Rules not processed for user `4de0f4da2d2e464fb9501fa58e344bed`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:09.743846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:09.893118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:09.893361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 829/1662] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:09.893815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:09.894093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:09.932302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] MFA Rules not processed for user `4de0f4da2d2e464fb9501fa58e344bed`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:09.933530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:09.951463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 834/1663] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:09.963901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:10.197149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe5b89-6389-4c34-9d40-e9a5d90f565f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:10.222170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:10.222858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:10.223145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:10.223426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:10.241234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:10.243788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698791f0-0d31-43b6-9b2f-4ec9204fe9e1 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:10.271005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 830/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:12.742588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:13.013561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c71a-244f-4081-bc5b-3f2c1645783d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:13.022708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:13.023425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:13.023770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:13.024052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:13.269314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:13.271341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec52c3-4129-4982-8576-2b8317f23214 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:13.330033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 835/1665] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:13.421054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:13.421591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:13.422423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:13.474803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65e9f-3162-4311-a898-52abbb73ab46 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:13.475643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65e9f-3162-4311-a898-52abbb73ab46 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:13.476014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b65e9f-3162-4311-a898-52abbb73ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:13.521380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:13.523234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:13.620864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-43b65e9f-3162-4311-a898-52abbb73ab46 None None] MFA Rules not processed for user `25229d5ef3be47988accfdee5f9209b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:13.633765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-43b65e9f-3162-4311-a898-52abbb73ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:13.865454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 836/1666] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:13.865454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:13.866144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 831/1667] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:13.866144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:13.880648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:13.880960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:13.973301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] MFA Rules not processed for user `4de0f4da2d2e464fb9501fa58e344bed`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:13.976919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:13.998407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 837/1668] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:13.999530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:14.033093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c736874-a03c-4afd-a4fc-13b7a85c9fbd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:14.052346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:14.053246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:14.054100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:14.055072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:14.068553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2abaf3-9ef6-43b7-8cb3-8c08d8f8042f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:14.078253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:14.080678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:14.091660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:14.092934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:14.093416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:14.093912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] PATH_INFO: `/v3/users/2d53bca1bae04b9c973fee7f05a2648b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:14.095583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d53bca1bae04b9c973fee7f05a2648b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:14.099418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:14.106246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 838/1669] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:14.225233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:14.227511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:14.237631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d53bca1bae04b9c973fee7f05a2648b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:14.288065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d53bca1bae04b9c973fee7f05a2648b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:14.290613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d53bca1bae04b9c973fee7f05a2648b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:14.293829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d53bca1bae04b9c973fee7f05a2648b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:14.318883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b11447a9-c435-4912-9d30-2af9021809c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d53bca1bae04b9c973fee7f05a2648b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:14.347302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 832/1670] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:13 2022] DELETE /identity/v3/users/2d53bca1bae04b9c973fee7f05a2648b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:14.349891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:14.350568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:14.351051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:14.404796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:14.408005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:14.549695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b465-4a76-48ff-b1c2-efbf123b2f4b service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:14.605701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 833/1671] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:14.677963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:14.680394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:14.738911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:14.739829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:14.740252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:14.740700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:14.747330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:14.853922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1127fd7-cbf9-4276-a047-eff7292221ee None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:14.863582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:14.865264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:14.865752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:14.866538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:14.882905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:14.886552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:14.887608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b5f7-2958-4b61-89ff-eef8601cc031 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:14.888859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:14.910195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 839/1673] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:48:14.910488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 834/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:15.839209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:15.845755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:15.900949 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e830674-9251-4509-a414-44e4cec09a58 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:15.924119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:15.925826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:15.928043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:15.928662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] PATH_INFO: `/v3/users/d98439c4e0a7406f8be9058570e01687` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:15.930388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98439c4e0a7406f8be9058570e01687)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:15.934080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:16.043654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98439c4e0a7406f8be9058570e01687'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:16.070677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98439c4e0a7406f8be9058570e01687'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:16.071734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98439c4e0a7406f8be9058570e01687'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:16.072245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98439c4e0a7406f8be9058570e01687'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:16.101248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68093838-eaf0-43f7-bf96-d9d528504e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98439c4e0a7406f8be9058570e01687'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:16.157779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 835/1674] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:15 2022] DELETE /identity/v3/users/d98439c4e0a7406f8be9058570e01687 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:16.470513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:16.471160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:16.471160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:16.538405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:16.538405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:16.538405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:16.545330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:16.547372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.662888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] MFA Rules not processed for user `e2a00f1a578d44abadaa39db5235363a`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:16.666685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.727988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 840/1675] 10.222.0.32 () {58 vars in 1015 bytes} [Tue May 10 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:16.729162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:16.731617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.879938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 836/1676] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:16.916443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:16.918903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:16.982221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fd565-66ff-4ccc-9361-3ce489becaaf None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:17.006349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:17.011999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.012596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.012723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] PATH_INFO: `/v3/projects/8e5268ab3fcf4ec1a112f8e76dbeccd7` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.014901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5268ab3fcf4ec1a112f8e76dbeccd7)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:17.017303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:17.167606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5268ab3fcf4ec1a112f8e76dbeccd7', 'request_id': 'req-4547c1e5-ea52-4a14-b351-1b2d515c6f99'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.196390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1f60-ad0f-41cc-807f-44a213ab013c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:17.208975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5268ab3fcf4ec1a112f8e76dbeccd7', 'request_id': 'req-4547c1e5-ea52-4a14-b351-1b2d515c6f99'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.229588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5268ab3fcf4ec1a112f8e76dbeccd7', 'request_id': 'req-4547c1e5-ea52-4a14-b351-1b2d515c6f99'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.268472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] The token cache is being invalidate because project 8e5268ab3fcf4ec1a112f8e76dbeccd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:17.269076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.270206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4547c1e5-ea52-4a14-b351-1b2d515c6f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.278430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 841/1677] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:16 2022] DELETE /identity/v3/projects/8e5268ab3fcf4ec1a112f8e76dbeccd7 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:17.280565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.280873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.282287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.375013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:17.380369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:17.414481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:17.415018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.415305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.415586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.421831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:17.604479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 842/1678] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:17.607710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:17.611141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:17.627763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:17.636997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e370-e4bf-460e-9e12-4c114b00cffd service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:17.654421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab95318-d323-43ac-ac78-7ee24db3a1a9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:17.673804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 837/1679] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:17.676010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:17.677197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.677549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.678150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.678452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.678858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.679990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] PATH_INFO: `/v3/projects/9df655e0767f4fc0a42b13808f15e843` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.683294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df655e0767f4fc0a42b13808f15e843)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:17.688136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:17.721221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:17.729632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:17.754499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 838/1680] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:17.757465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:17.781279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aad29e-7a39-46d0-8eb8-73839d2ad3c3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:17.816999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df655e0767f4fc0a42b13808f15e843', 'request_id': 'req-9a79869b-832b-45ab-be35-8f62cc65bf19'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.840025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df655e0767f4fc0a42b13808f15e843', 'request_id': 'req-9a79869b-832b-45ab-be35-8f62cc65bf19'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.860441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df655e0767f4fc0a42b13808f15e843', 'request_id': 'req-9a79869b-832b-45ab-be35-8f62cc65bf19'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.886900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] The token cache is being invalidate because project 9df655e0767f4fc0a42b13808f15e843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:17.887258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.889338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:17.901300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 843/1681] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:17 2022] DELETE /identity/v3/projects/9df655e0767f4fc0a42b13808f15e843 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:17.904141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:17.907738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:17.963068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:17.963750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:17.964035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:17.964341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:17.965077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:17.965397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:17.967034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:17.992876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 839/1682] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:18.000622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:18.016217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:18.053548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6b7f4-53c6-47ab-a153-cb4907b143e6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.075626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.076323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.076610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.076888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.077594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.079529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:18.094616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79869b-832b-45ab-be35-8f62cc65bf19 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.113798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.115160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.115679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.115873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] PATH_INFO: `/v3/users/e39433bfc6fb486686b4f6032192ddec` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.126409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39433bfc6fb486686b4f6032192ddec)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.127398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: WARNING py.warnings [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:48:18.127398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: warnings.warn(msg) May 10 16:48:18.127398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: May 10 16:48:18.128785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:18.178195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 840/1683] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:17 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:18.186048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:18.341335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39433bfc6fb486686b4f6032192ddec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:18.469392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d1bd7-ab9b-4df0-a951-5d2d938420ca admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.493500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39433bfc6fb486686b4f6032192ddec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:18.494674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39433bfc6fb486686b4f6032192ddec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:18.495928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39433bfc6fb486686b4f6032192ddec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:18.509171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.509731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39433bfc6fb486686b4f6032192ddec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:18.510364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.516817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.518719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.532379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 844/1684] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:17 2022] DELETE /identity/v3/users/e39433bfc6fb486686b4f6032192ddec => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:18.536165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.544002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:18.545336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:18.546702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:18.640807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 841/1685] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:18 2022] POST /identity/v3/users => generated 287 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:18.660802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:18.665431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:18.702262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3454-f267-4184-a138-8dad8e4f9031 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.712226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc34b-e0c5-408b-a6bb-af215643c326 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.718652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.719341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.719620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.739994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.768664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:18.819504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.823083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:18.860891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 845/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:18.914868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.915899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.916361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.916810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.918099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.921002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:18.942919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 842/1687] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:18.944769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:18.972935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea2467-c7af-4839-b1b4-a892c32494ed service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:18.988986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:18.990148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:18.990638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:18.991120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:18.993037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:18.996337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ce59-24a2-4839-b277-711dd7c86f47 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:19.045044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:19.052723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 846/1688] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:19.103956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef28cc3-0bbd-49b5-be4d-fc39d36f4cb9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:19.129360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:19.133496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:19.138031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:19.150265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] PATH_INFO: `/v3/projects/1913a18fe0994e679c6151c9cabb5160/users/73cab7550234436d9fad205163b3b72e/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:19.209672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1913a18fe0994e679c6151c9cabb5160, user_id=73cab7550234436d9fad205163b3b72e, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:19.219893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:19.286370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 843/1689] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:19 2022] PUT /identity/v3/projects/1913a18fe0994e679c6151c9cabb5160/users/73cab7550234436d9fad205163b3b72e/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:19.311839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:19.312343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:19.312842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:19.452353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] MFA Rules not processed for user `73cab7550234436d9fad205163b3b72e`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:19.456603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:19.861030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:19.887043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 847/1690] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 575 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:19.991696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:19.994283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:20.011708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463412b-3f00-4a5f-a440-649c67c52af0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:20.033006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:20.033363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:20.033650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:20.034200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:20.034871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:20.037659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:20.108623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 844/1691] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:19 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:20.112702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:20.401212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0d56-fcd4-4b32-b03f-efefb4fb95cb None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:20.427230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:20.430648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbcaa6-eead-4035-9ed7-74cfc46a508b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:20.432411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:20.435848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:20.435848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] PATH_INFO: `/v3/projects/3df51ca5b09b40378055260f8bd5e9da` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:20.443003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df51ca5b09b40378055260f8bd5e9da)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:20.457837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:20.473935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:20.476087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:20.477885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:20.478913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:20.480548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:20.488794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:20.617839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 845/1692] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:20 2022] POST /identity/v3/users => generated 292 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:20.635924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:20.699705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df51ca5b09b40378055260f8bd5e9da', 'request_id': 'req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:20.727862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817f6ed-f1ae-46f4-b0a1-98cbd4c287fb admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:20.733414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df51ca5b09b40378055260f8bd5e9da', 'request_id': 'req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:20.754676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df51ca5b09b40378055260f8bd5e9da', 'request_id': 'req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:20.784237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] The token cache is being invalidate because project 3df51ca5b09b40378055260f8bd5e9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:20.786213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:20.787434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-df91e636-e2c0-4b6d-98d9-3c2b1d3388ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:20.793209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 848/1693] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:19 2022] DELETE /identity/v3/projects/3df51ca5b09b40378055260f8bd5e9da => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:20.837761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f570d-c176-4935-aa73-d2623d2ff15e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:20.851209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f570d-c176-4935-aa73-d2623d2ff15e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:20.856069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f570d-c176-4935-aa73-d2623d2ff15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:20.970102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-701f570d-c176-4935-aa73-d2623d2ff15e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:20.971416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-701f570d-c176-4935-aa73-d2623d2ff15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:21.034455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.035313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.035661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.036005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.039367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.041625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.074644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 846/1694] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:21.083131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.095545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:21.128836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d064e4-981a-4d8b-8c36-21445a7fb92c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:21.151511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.152560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.157231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.162465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] PATH_INFO: `/v3/projects/5692a0553336431aa0f286c28e2dac43/users/be4c59eb2a8d4cb0985d9c73102faf4d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.222010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 849/1695] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:21.224135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.224557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.224853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.244467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5692a0553336431aa0f286c28e2dac43, user_id=be4c59eb2a8d4cb0985d9c73102faf4d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.251846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.293175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 847/1696] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:21 2022] PUT /identity/v3/projects/5692a0553336431aa0f286c28e2dac43/users/be4c59eb2a8d4cb0985d9c73102faf4d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:21.294516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.295077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:21.296715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:21.569575 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4a0e-5678-42c5-bb50-fe0d91098ae0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:21.586975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 850/1697] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:21.591496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.606950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb795-0ab2-41ad-b86c-e3e68f94dcbb None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:21.619171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.626355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.628657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.629480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.630426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.630947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.631462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.635762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.637033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:21.637590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.643693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.645170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.646970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.714643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:21.715827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.718340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 848/1699] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:21.719298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.755546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898b22-0d98-4a25-80e1-1ae4251b1577 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:21.755749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a660-ca2a-47c3-ad49-8eebad3a6c58 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:21.782060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.783238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.784329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:21.785105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.785537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.786103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.789947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.791678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] PATH_INFO: `/v3/projects/5692a0553336431aa0f286c28e2dac43/users/be4c59eb2a8d4cb0985d9c73102faf4d/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.797171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5692a0553336431aa0f286c28e2dac43, user_id=be4c59eb2a8d4cb0985d9c73102faf4d, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.797803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:21.808753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.809304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a45f1-5614-4e0b-b593-1563f80b28be admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:21.843083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 849/1700] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:21 2022] PUT /identity/v3/projects/5692a0553336431aa0f286c28e2dac43/users/be4c59eb2a8d4cb0985d9c73102faf4d/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:21.859059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:21.862472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:21.864079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:21.918070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 852/1701] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:21 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:21.919315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:21.953364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] MFA Rules not processed for user `be4c59eb2a8d4cb0985d9c73102faf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:21.954653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:22.118970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ce5b-ff87-4a42-a454-8f35e30c7ee4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:22.133121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:22.136523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.136962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.137171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.138012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:22.143491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 850/1702] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:22.144534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:22.147982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:22.151323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:22.201801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 853/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:21 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:22.206503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:22.230586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b992008-ff01-4155-be73-7db3872c17ce admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:22.257583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:22.260934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.261440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.261843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.262835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:22.264903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:22.266464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9042d-d1c6-4f13-a014-17e646ad2701 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:22.276223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:22.277221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.277653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.278097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.308145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:22.313750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:22.322226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 854/1704] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:22.323244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:22.352031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a56d8-edd4-49ab-88c3-230870409c0c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:22.366454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:22.367722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.368659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.368953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.369500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 851/1705] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:22.371590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:22.377142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe16bec-81a6-4db2-9eee-f9b40b579cbd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:22.407267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 855/1706] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:22.409603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:22.438976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65cdc5-047e-42e7-84da-27d17ce60b0f service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:22.455036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:22.457111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.460289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.461910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] PATH_INFO: `/v3/projects/b23c944c851f43c697b2f55d335a6c78/users/aa2516ae05a84f3fbd77bed1a7c7eaf5/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.505646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23c944c851f43c697b2f55d335a6c78, user_id=aa2516ae05a84f3fbd77bed1a7c7eaf5, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:22.518540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:22.555303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 852/1707] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:22 2022] PUT /identity/v3/projects/b23c944c851f43c697b2f55d335a6c78/users/aa2516ae05a84f3fbd77bed1a7c7eaf5/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:22.567175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:22.567716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:22.568144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:22.639875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] MFA Rules not processed for user `aa2516ae05a84f3fbd77bed1a7c7eaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:22.641425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:22.818983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:22.819814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 856/1708] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:23.024238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297490f-4602-4842-bc90-bc242466488c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.051904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.068441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.068882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.070618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.074888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.075863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.149355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 853/1709] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:22 2022] POST /identity/v3/projects => generated 387 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:23.154061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.180252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8781-b11a-43ba-8e09-c697c33ba155 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.273266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.274714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.275248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.275784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.276769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.285426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.335082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 857/1710] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:23 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:23.339308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.354976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccaebc-9884-4254-8c41-66a5fe1c7001 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.367883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.369084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.369441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.375133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.380605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.386711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.428234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 854/1711] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:23.432489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.456805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f838-1dd1-49aa-8f77-d0b2d3e3fadc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.477334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.480625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.482014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.482635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.483651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.489893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69282f21-0457-460b-be58-05ad903647fa admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.510557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 858/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:23.514931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.533645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc88f7-bee8-43e7-8647-a82513a5c936 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.561085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.562015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.562302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.562583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] PATH_INFO: `/v3/projects/3d62c9e6c5a14f32889d4b60d03b2538/users/cf44e088498b484d843effa10ac18d09/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.614888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d62c9e6c5a14f32889d4b60d03b2538, user_id=cf44e088498b484d843effa10ac18d09, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.619495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.661563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 855/1713] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:23 2022] PUT /identity/v3/projects/3d62c9e6c5a14f32889d4b60d03b2538/users/cf44e088498b484d843effa10ac18d09/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:23.663210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.663473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.663923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.779062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] MFA Rules not processed for user `cf44e088498b484d843effa10ac18d09`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:23.785103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:23.824405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:23.921102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78fa9-7d12-438d-9fab-e0167888bba7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:23.927612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:23.928811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:23.929557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:23.930069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] PATH_INFO: `/v3/users/73cab7550234436d9fad205163b3b72e` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:23.931887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cab7550234436d9fad205163b3b72e)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:23.934135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:23.997447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cab7550234436d9fad205163b3b72e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:23.998710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 859/1714] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:24.003048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.017631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87080a0-1740-40f1-8023-f274405b6dad None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.018133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cab7550234436d9fad205163b3b72e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:24.019214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cab7550234436d9fad205163b3b72e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:24.020140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cab7550234436d9fad205163b3b72e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:24.035270 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:24.035965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.036256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.036561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.037267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:24.039925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:24.041900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d822eed0-ba74-4fe8-a7d0-11565e340781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cab7550234436d9fad205163b3b72e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:24.072605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 856/1715] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:23 2022] DELETE /identity/v3/users/73cab7550234436d9fad205163b3b72e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:24.091319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.093734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.094124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.112783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 860/1716] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:24 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:24.116538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.120730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:24.157801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:24.159133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:24.332768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2552d5c-db14-4fa7-a3bd-b1ba19d0289a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.345887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:24.347025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.347547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.348179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.349130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:24.352501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:24.378383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 857/1717] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:24.394684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 861/1718] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:24 2022] POST /identity/v3/users => generated 300 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:24.399541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.448359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d29191-6a7e-4d58-9353-19ce858db3b5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.458858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:24.463062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.463704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.463996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.465017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:24.467488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:24.485874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 858/1719] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:24.489969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.512682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.518072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:24.521460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349802f-ac13-45cd-96ee-427dbe45f0ba admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.562622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:24.565815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.565959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.567350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] PATH_INFO: `/v3/projects/58dd7b5ef925453d9404b4f7557ea13c/users/07ac4b52d49d451f83c00e71b5d0762f/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.624856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dd7b5ef925453d9404b4f7557ea13c, user_id=07ac4b52d49d451f83c00e71b5d0762f, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:24.632217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:24.658726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 862/1720] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:24 2022] PUT /identity/v3/projects/58dd7b5ef925453d9404b4f7557ea13c/users/07ac4b52d49d451f83c00e71b5d0762f/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:24.662668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.796582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd32459-66a3-4856-9d12-818e72b818d6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.858371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd32812-7f1f-43c9-ac65-cb1caa0518c1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.873218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:24.874321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:24.874831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:24.875306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:24.877353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:24.885456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:24.917643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 863/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:24.922223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:24.981698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0034a-0361-4c96-ad54-5c055fedc65c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:24.996992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:25.001037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.001716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.002220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] PATH_INFO: `/v3/projects/58dd7b5ef925453d9404b4f7557ea13c/users/07ac4b52d49d451f83c00e71b5d0762f/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.011967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dd7b5ef925453d9404b4f7557ea13c, user_id=07ac4b52d49d451f83c00e71b5d0762f, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:25.019759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40bf6-6a84-4f89-9c82-9c5db755f420 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:25.024026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:25.024789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.025092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.025366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.050270 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 864/1722] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:24 2022] PUT /identity/v3/projects/58dd7b5ef925453d9404b4f7557ea13c/users/07ac4b52d49d451f83c00e71b5d0762f/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:25.054244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:25.056361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:25.060828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672014-f262-477b-9b7e-6d72fbcf5b4d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.061810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672014-f262-477b-9b7e-6d72fbcf5b4d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.062831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5672014-f262-477b-9b7e-6d72fbcf5b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.084256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 859/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:25.140249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a5672014-f262-477b-9b7e-6d72fbcf5b4d None None] MFA Rules not processed for user `07ac4b52d49d451f83c00e71b5d0762f`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:25.142071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a5672014-f262-477b-9b7e-6d72fbcf5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:25.423242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 865/1724] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:25.430527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:25.431972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:25.447497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e838-3119-4257-9d7b-a2a0bff13891 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.447786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e838-3119-4257-9d7b-a2a0bff13891 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.449181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18e838-3119-4257-9d7b-a2a0bff13891 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.449489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 866/1725] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:48:25.534381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38219-ee66-4a8d-a997-db22a491910d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.534959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38219-ee66-4a8d-a997-db22a491910d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.535408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b38219-ee66-4a8d-a997-db22a491910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.595915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c0b38219-ee66-4a8d-a997-db22a491910d None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:25.613125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c0b38219-ee66-4a8d-a997-db22a491910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:25.635297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4c0d3-15f1-4a28-a413-fffaaa7bd669 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:25.783862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:25.785367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.788075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.789135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.789731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 867/1726] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:25.792762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.792762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.793533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.817284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:25.822962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:25.828090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] MFA Rules not processed for user `25229d5ef3be47988accfdee5f9209b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:25.831341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:25.850522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 860/1727] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:25.852783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:25.856323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:25.894410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea9e3-62ec-4847-9d24-afb235250f32 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:25.914019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:25.916082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:25.917191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:25.917861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:25.967297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:25.977753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa5bc-ce3f-419b-9efb-98b7d227c238 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:26.005967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 868/1728] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:26.018566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 861/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:27.193502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:27.200030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:27.238672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137e2aa-cf62-4868-b20d-132d7bc61894 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:27.250762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:27.254315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:27.254744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:27.255207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:27.260028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:27.388700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac393-cd9a-4949-809a-c46c6bcfaa86 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:27.389542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac393-cd9a-4949-809a-c46c6bcfaa86 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:27.390014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ac393-cd9a-4949-809a-c46c6bcfaa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:27.435912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:27.438958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:27.453170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-605ac393-cd9a-4949-809a-c46c6bcfaa86 None None] MFA Rules not processed for user `e2a00f1a578d44abadaa39db5235363a`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:27.454592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-605ac393-cd9a-4949-809a-c46c6bcfaa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:27.485569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 869/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:27.754069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 862/1731] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:29.436794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:29.438180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:29.502529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f07f8-1f4b-4d2f-9908-13455eb85053 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:29.503450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f07f8-1f4b-4d2f-9908-13455eb85053 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:29.503450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f07f8-1f4b-4d2f-9908-13455eb85053 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:29.504743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 863/1732] 10.222.0.48 () {54 vars in 912 bytes} [Tue May 10 16:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:29.510618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:29.510901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:29.511180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:29.593725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:29.594966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:29.605517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411e31e-59e1-49e9-9373-29bfdeb5009a service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:29.620897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:29.622313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:29.622741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:29.623322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] PATH_INFO: `/v3/projects/1913a18fe0994e679c6151c9cabb5160` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:29.625221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1913a18fe0994e679c6151c9cabb5160)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:29.627860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:29.718541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1913a18fe0994e679c6151c9cabb5160', 'request_id': 'req-23d8ad22-62ec-4d1b-a647-b30dda14d915'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:29.737975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1913a18fe0994e679c6151c9cabb5160', 'request_id': 'req-23d8ad22-62ec-4d1b-a647-b30dda14d915'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:29.752705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1913a18fe0994e679c6151c9cabb5160', 'request_id': 'req-23d8ad22-62ec-4d1b-a647-b30dda14d915'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:29.797881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] The token cache is being invalidate because project 1913a18fe0994e679c6151c9cabb5160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:29.798389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:29.800596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:29.803430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 870/1733] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:29 2022] DELETE /identity/v3/projects/1913a18fe0994e679c6151c9cabb5160 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:29.820202 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:29.824383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:29.890018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 864/1734] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:48:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:30.046196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:30.048011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:30.083289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf03e4-ecf7-454b-a6ec-3ee3276d3a79 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:30.136547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ad22-62ec-4d1b-a647-b30dda14d915 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:30.146837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:30.147926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:30.148212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:30.148510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] PATH_INFO: `/v3/users/be4c59eb2a8d4cb0985d9c73102faf4d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:30.152180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4c59eb2a8d4cb0985d9c73102faf4d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:30.157361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:30.216620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:30.217390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:30.217674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:30.218455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:30.237479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:30.240057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:30.261177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4c59eb2a8d4cb0985d9c73102faf4d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:30.263211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 865/1735] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:30.282272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4c59eb2a8d4cb0985d9c73102faf4d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:30.284160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4c59eb2a8d4cb0985d9c73102faf4d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:30.286000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4c59eb2a8d4cb0985d9c73102faf4d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:30.305119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4f4038d2-01fd-4f6b-a961-5a1026a6c73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4c59eb2a8d4cb0985d9c73102faf4d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:30.325993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 871/1736] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:29 2022] DELETE /identity/v3/users/be4c59eb2a8d4cb0985d9c73102faf4d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:31.279334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:31.296484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56c6d3-f57b-455f-80c4-a0944e246267 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:31.417091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:31.418086 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.418379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.418654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] PATH_INFO: `/v3/projects/5692a0553336431aa0f286c28e2dac43` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.420102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5692a0553336431aa0f286c28e2dac43)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:31.421445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: WARNING py.warnings [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 16:48:31.421445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: warnings.warn(msg) May 10 16:48:31.421445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: May 10 16:48:31.423347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:31.490587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5692a0553336431aa0f286c28e2dac43', 'request_id': 'req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.511078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5692a0553336431aa0f286c28e2dac43', 'request_id': 'req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.535904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5692a0553336431aa0f286c28e2dac43', 'request_id': 'req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.559531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] The token cache is being invalidate because project 5692a0553336431aa0f286c28e2dac43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:31.559827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.561781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8fb731f4-7a9c-4cfe-aabc-97e6717dec18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:31.565899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 866/1737] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:31 2022] DELETE /identity/v3/projects/5692a0553336431aa0f286c28e2dac43 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:31.571891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd664d-65ca-401c-9324-c7d9fa543eb6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.572576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd664d-65ca-401c-9324-c7d9fa543eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.573015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd664d-65ca-401c-9324-c7d9fa543eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.596185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83347-6850-4f66-addf-a6b5ea0b039b None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.596545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83347-6850-4f66-addf-a6b5ea0b039b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.597110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f83347-6850-4f66-addf-a6b5ea0b039b None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.599178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 867/1738] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:48:31.625110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.626333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.626333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.641788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e6dd664d-65ca-401c-9324-c7d9fa543eb6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:31.643397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e6dd664d-65ca-401c-9324-c7d9fa543eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:31.664994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:31.667282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:31.812815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 872/1739] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:31.822463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.822739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.823049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.864231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:31.866121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:31.870826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 868/1740] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:31.878619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 873/1741] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:31.884185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:31.885542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:31.887359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:31.904300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6461-076f-4de5-b1ed-4e30e1544389 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:31.919920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:31.921358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.921750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.922203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.923212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:31.923821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:31.926404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:31.930637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bfa0b-3a4d-4982-8ca5-2beaf9195546 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:31.942241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 869/1742] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:31.947850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:31.948523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:31.949204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.949486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.949760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.974524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c59-ab74-4a6c-929b-2c3517339646 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:31.975278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:31.978267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:31.987260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:31.988302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:31.989114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:31.989331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:31.990049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:31.992442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:31.994814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 874/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:32.043670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 870/1744] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:31 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:32.047657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.076430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03167584-9e76-4e91-a938-15ce03d89c83 service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.245852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.249000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.249290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.249647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.250799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.258679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.316307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 875/1745] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:32.321810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.339183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170473-c0ca-4e2e-9327-f75303707511 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.344928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.345632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.346129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.346243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.347073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.349305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.362083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 871/1746] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:32.366283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.399681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af41-d31e-4a7f-bfdf-aa9ca1de1ed1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.408693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.408693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.408693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.409472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.411412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.413440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65124ddf-a900-40f0-9ca3-a643dd12ce22 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.433381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 876/1747] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:32.438125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:32.449999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26027-e8de-40a9-b65d-1e0014381a9b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:32.455545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:32.457169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.458163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.472758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] PATH_INFO: `/v3/projects/2952b913ca35442493cef13cce74c4f8/users/146855477ed241ce915a77d6884bd88c/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:32.852121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2952b913ca35442493cef13cce74c4f8, user_id=146855477ed241ce915a77d6884bd88c, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:32.870664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:32.929662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 872/1748] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:32 2022] PUT /identity/v3/projects/2952b913ca35442493cef13cce74c4f8/users/146855477ed241ce915a77d6884bd88c/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:32.941827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:32.942354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:32.942354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.031532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] MFA Rules not processed for user `146855477ed241ce915a77d6884bd88c`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:33.033803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:33.213265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 877/1749] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:33.218872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.380382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e608ee2-7458-4393-b3be-901c6b03597b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.390221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.391071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.391363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.391631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.392703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.395203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.451688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 873/1750] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:33 2022] POST /identity/v3/projects => generated 367 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:33.456040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.468348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ef603-9b71-4498-b2ed-5445548c6958 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.607995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.609045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.609502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.610619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.611644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.623059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.664837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 878/1751] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:33 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:33.669968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.685022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf67a4-8819-407a-a5b7-ca4fae86b148 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.691352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.692673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.693120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.693589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.695531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.697673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.712730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 874/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:33.717338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.730117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd51de2-3cd1-4776-b057-72b9c8f145fa admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.736896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.738103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.738577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.739003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] PATH_INFO: `/v3/projects/e45e2864a85e4cb78402ead476777011/users/85a8ad958913447797696ca9dd769283/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.768197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e2864a85e4cb78402ead476777011, user_id=85a8ad958913447797696ca9dd769283, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.771828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.797911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 879/1753] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:33 2022] PUT /identity/v3/projects/e45e2864a85e4cb78402ead476777011/users/85a8ad958913447797696ca9dd769283/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:33.802374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.833027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3f059-c9f7-420e-a151-af7527fe4d36 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.954435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:33.955075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:33.955356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:33.955638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:33.956903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:33.958699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e622cd-d345-402c-bed4-0403d6f74d53 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:33.972338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 875/1754] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:33.976007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:33.987883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c78cd-d59f-46ec-8b87-f952ec9410b9 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:33.998483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:34.001286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:34.001842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:34.002339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] PATH_INFO: `/v3/projects/e45e2864a85e4cb78402ead476777011/users/85a8ad958913447797696ca9dd769283/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:34.009132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e2864a85e4cb78402ead476777011, user_id=85a8ad958913447797696ca9dd769283, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:34.017094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:34.055037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:34.056015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:34.056490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:34.059369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 880/1755] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:33 2022] PUT /identity/v3/projects/e45e2864a85e4cb78402ead476777011/users/85a8ad958913447797696ca9dd769283/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:34.092799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] MFA Rules not processed for user `85a8ad958913447797696ca9dd769283`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:34.094646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:34.211677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 876/1756] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:34.226665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:34.236064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:34.343648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926d2b-11ff-4770-97c4-351aec88bc31 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:34.351853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:34.352576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:34.352918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:34.353200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:34.375518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:34.377242 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:34.391903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 881/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:34.446836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:34.466618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc409f-dbb9-4f06-bee6-4e1ac751374d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:34.473483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:34.475310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:34.475595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:34.476661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:34.604887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:34.606610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:34.628117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 877/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:38.642415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:38.811049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec4a4-95fc-4a1c-b96a-91963891962c service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:38.817371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:38.821122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:38.822986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:38.823221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] PATH_INFO: `/v3/users/146855477ed241ce915a77d6884bd88c` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:38.824939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146855477ed241ce915a77d6884bd88c)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:38.830941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:38.926820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:38.928794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:38.940739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146855477ed241ce915a77d6884bd88c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:38.947573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41854fc-044e-4558-9ec7-e79c7d3857a2 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:38.955939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:38.957721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:38.958240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:38.958605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:38.963902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:38.969937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146855477ed241ce915a77d6884bd88c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:38.970961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146855477ed241ce915a77d6884bd88c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:38.971843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146855477ed241ce915a77d6884bd88c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:38.989901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e44ffed4-a3ba-4f77-8f82-bc9826051001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146855477ed241ce915a77d6884bd88c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:39.017631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 882/1759] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:38 2022] DELETE /identity/v3/users/146855477ed241ce915a77d6884bd88c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:39.025506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:39.025808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:39.026137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:39.067259 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:39.071543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:39.082561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:39.085472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:39.101438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 878/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:39.173137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 883/1761] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:39.206354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:39.207876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:39.324488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd670ec-f9a7-4b33-a737-72c85a541eef service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:39.402694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:39.403458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:39.403750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:39.404037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:39.427628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:39.432159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:39.453161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 879/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:40.229468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:40.230905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:40.269894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7e3ad-1a55-4b5b-b4af-955745a43807 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:40.284863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:40.285748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:40.286043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:40.286309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] PATH_INFO: `/v3/projects/2952b913ca35442493cef13cce74c4f8` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:40.291961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2952b913ca35442493cef13cce74c4f8)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:40.294044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:40.379603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2952b913ca35442493cef13cce74c4f8', 'request_id': 'req-15c77088-04b9-4d53-a0f1-2966d7b7f158'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.390840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2952b913ca35442493cef13cce74c4f8', 'request_id': 'req-15c77088-04b9-4d53-a0f1-2966d7b7f158'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.402325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2952b913ca35442493cef13cce74c4f8', 'request_id': 'req-15c77088-04b9-4d53-a0f1-2966d7b7f158'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.417872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] The token cache is being invalidate because project 2952b913ca35442493cef13cce74c4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:40.418215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.419138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.421265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 884/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:40 2022] DELETE /identity/v3/projects/2952b913ca35442493cef13cce74c4f8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:40.425525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:40.451696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852b185-9aa5-4c05-a0a5-982c9163e247 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:40.650763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:40.652627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:40.653060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:40.653595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] PATH_INFO: `/v3/users/85a8ad958913447797696ca9dd769283` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:40.659932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a8ad958913447797696ca9dd769283)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:40.664542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:40.738967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a8ad958913447797696ca9dd769283'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.754443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a8ad958913447797696ca9dd769283'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.755189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a8ad958913447797696ca9dd769283'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.755793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a8ad958913447797696ca9dd769283'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.766523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e6755898-0dd7-4bbf-83e8-3071f7fd1bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a8ad958913447797696ca9dd769283'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:40.783233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 880/1764] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:40 2022] DELETE /identity/v3/users/85a8ad958913447797696ca9dd769283 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:41.190852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.192902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:41.206921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c77088-04b9-4d53-a0f1-2966d7b7f158 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.269365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.270379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.270630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.270902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] PATH_INFO: `/v3/projects/e45e2864a85e4cb78402ead476777011` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.272181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e2864a85e4cb78402ead476777011)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.275932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.330692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e2864a85e4cb78402ead476777011', 'request_id': 'req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:41.342568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e2864a85e4cb78402ead476777011', 'request_id': 'req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:41.351398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e2864a85e4cb78402ead476777011', 'request_id': 'req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:41.362908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] The token cache is being invalidate because project e45e2864a85e4cb78402ead476777011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:41.363224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:41.363885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e1c33ed1-8ee7-450b-9a12-fe31d4c0451e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:41.365484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 885/1765] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:41 2022] DELETE /identity/v3/projects/e45e2864a85e4cb78402ead476777011 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:41.371748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.372335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.372830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.399699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:41.400956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:41.463374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 881/1766] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:41.472370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.472660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.472939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.497084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:41.498884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:41.507825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 886/1767] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:41.512303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.522217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3dc8-d711-47cb-80fe-3b8f1eac03af None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.528047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.528737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.529024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.529294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.530040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:41.530351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.531951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.544968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 882/1768] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:41.549574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.559857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f2c26-e84d-4128-bb01-93c281815e8a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.565548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.566357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.566740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.567022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.567891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.570710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.604454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 887/1769] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:41.608811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.620977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f360d-1c36-411e-be86-aac938fe56ef admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.700816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.701576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.701785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.702059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.703470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.705778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.734191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 883/1770] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:41.738399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.750221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf96c7d-c126-4c52-82fd-93137b412990 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.761251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.762030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.762275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.762554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.763326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.764984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.777551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 888/1771] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:41.781678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.793085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e32fe-6331-4f17-b99d-cbcd0f2bf6d3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.807871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.808648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.808945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.809251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.810097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.811940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df795838-38da-48ea-b1e2-7a6df7f75b83 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.827567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 884/1772] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:41.829063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:41.840014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b77e2e-3a9c-49b0-9c8e-e9e98d0d09dc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:41.846686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:41.847606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.847884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.848151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] PATH_INFO: `/v3/projects/ab3b8b705b3d429e87cde0438ff73dea/users/9ce5dc9a31a44eee88860903dcd18e32/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.864505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3b8b705b3d429e87cde0438ff73dea, user_id=9ce5dc9a31a44eee88860903dcd18e32, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:41.867205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:41.883328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 889/1773] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:41 2022] PUT /identity/v3/projects/ab3b8b705b3d429e87cde0438ff73dea/users/9ce5dc9a31a44eee88860903dcd18e32/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:41.893568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:41.893866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:41.894151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:41.923089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] MFA Rules not processed for user `9ce5dc9a31a44eee88860903dcd18e32`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:41.924315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:41.992423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 885/1774] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:41.997090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.066304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd97a0-6648-483f-a47b-c4d6e86cf640 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.072657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.073455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.073759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.074096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.074717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.076668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.105084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 890/1775] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:41 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:42.109266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.125971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421aa2f-7bf7-4544-9dbb-92ef382f063b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.191810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.192521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.192812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.193092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.193832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.196860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.219613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 886/1776] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:42 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:42.223859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.235884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b45e-8df2-4450-a3b1-c5f1f36a38fa admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.240701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.241917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.242206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.242481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.243210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.244833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.255720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 891/1777] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:42.261234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.271669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30589a80-8960-49b3-a90a-6195232be994 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.276859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.277756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.278046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.278325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] PATH_INFO: `/v3/projects/52f9eb3996274b52a449e70f5e3e8e99/users/0c7580be16064d229d50d98aae61ae35/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.294715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f9eb3996274b52a449e70f5e3e8e99, user_id=0c7580be16064d229d50d98aae61ae35, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.297554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.312135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 887/1778] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:42 2022] PUT /identity/v3/projects/52f9eb3996274b52a449e70f5e3e8e99/users/0c7580be16064d229d50d98aae61ae35/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:42.316204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.326536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafecaba-d739-4fd4-a2dd-b723f46120c4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.414671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.415548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.415806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.416366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.417345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.419450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74b43-d269-43a4-a0ed-2b756ba502c8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.433081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 892/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:42.437537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.449452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38af9-ad7a-4699-8563-93b3e9d7ba94 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.455945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.457013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.457299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.457652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] PATH_INFO: `/v3/projects/52f9eb3996274b52a449e70f5e3e8e99/users/0c7580be16064d229d50d98aae61ae35/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.461145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f9eb3996274b52a449e70f5e3e8e99, user_id=0c7580be16064d229d50d98aae61ae35, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.482886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.508663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 888/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:42 2022] PUT /identity/v3/projects/52f9eb3996274b52a449e70f5e3e8e99/users/0c7580be16064d229d50d98aae61ae35/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:42.521476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906988-bab4-4709-a473-f222ff7610f4 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.521791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906988-bab4-4709-a473-f222ff7610f4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.522041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74906988-bab4-4709-a473-f222ff7610f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.569349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-74906988-bab4-4709-a473-f222ff7610f4 None None] MFA Rules not processed for user `0c7580be16064d229d50d98aae61ae35`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:42.570583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-74906988-bab4-4709-a473-f222ff7610f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:42.702318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 893/1781] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:42.715477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:42.721664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:42.725200 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739bed2-477c-4a57-bbef-742dd549c5f7 None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.726229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739bed2-477c-4a57-bbef-742dd549c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.727387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739bed2-477c-4a57-bbef-742dd549c5f7 None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.730115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 894/1782] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:48:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:48:42.750249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.750542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.750928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.789715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:42.791243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:42.891744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 895/1783] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:42.957353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d53f-f0db-4e51-ab2b-eb6e4695e328 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:42.961629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:42.962292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:42.962630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:42.963209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:42.974111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:42.975746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:42.987611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 889/1784] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:43.124141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:43.141217 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc466b4a-9724-4ebd-b494-e9833dcabb23 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:43.147468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:43.149009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:43.149514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:43.150122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:43.260501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:43.262376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:43.294263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:43.294263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:43.301031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 896/1785] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:43.313583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d4713-e06e-427d-be87-01e6e9d0103d service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:43.333782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:43.334653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:43.335163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:43.337713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:43.365591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:43.368504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbb266-7c7f-45a6-9d5d-a9758d7ba09b service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:43.392500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 890/1786] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:46.197025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:46.199551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:46.387079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b035-abc6-4e9d-984b-76f61e2d2810 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:46.396075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:46.398023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:46.398333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:46.398717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] PATH_INFO: `/v3/users/ae60f3c4e1df468cb5404739503c5f22` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:46.407505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae60f3c4e1df468cb5404739503c5f22)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:46.411459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:46.484764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae60f3c4e1df468cb5404739503c5f22'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:46.499299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae60f3c4e1df468cb5404739503c5f22'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:46.500154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae60f3c4e1df468cb5404739503c5f22'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:46.501318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae60f3c4e1df468cb5404739503c5f22'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:46.515840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae60f3c4e1df468cb5404739503c5f22'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:46.535807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 897/1787] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:46 2022] DELETE /identity/v3/users/ae60f3c4e1df468cb5404739503c5f22 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:46.538393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:46.539090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:46.539090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:46.560836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:46.562048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:46.637496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 891/1788] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:46.647669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:46.649834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:46.715793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830781d0-486f-40df-87cd-a3cb72b53292 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:46.721817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:46.721817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:46.722368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:46.722450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:46.733921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:46.735453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:46.748262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 898/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:47.172398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.174297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.189497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc62035-f13a-48d9-95cc-896ca2b33774 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.195717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.196777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.197073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.197439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] PATH_INFO: `/v3/projects/a7ec0c457e5a4982bb33d621335966eb` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.198738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ec0c457e5a4982bb33d621335966eb)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.200854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.264434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.264923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ec0c457e5a4982bb33d621335966eb', 'request_id': 'req-cd371661-044a-4ab4-ad70-c03f34902b4f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.269271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.272567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ec0c457e5a4982bb33d621335966eb', 'request_id': 'req-cd371661-044a-4ab4-ad70-c03f34902b4f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.288302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ec0c457e5a4982bb33d621335966eb', 'request_id': 'req-cd371661-044a-4ab4-ad70-c03f34902b4f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.290668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925457-9823-4c27-b009-b53f3908cbcf service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.318290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] The token cache is being invalidate because project a7ec0c457e5a4982bb33d621335966eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:47.318812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.321192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.326863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 892/1790] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/projects/a7ec0c457e5a4982bb33d621335966eb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:47.328782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.331070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.393254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.395438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.395875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.396420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] PATH_INFO: `/v3/users/aa2516ae05a84f3fbd77bed1a7c7eaf5` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.399094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2516ae05a84f3fbd77bed1a7c7eaf5)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.402097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.451379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd371661-044a-4ab4-ad70-c03f34902b4f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.459591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.462901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.463403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.464605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] PATH_INFO: `/v3/users/a6c88d0a49e14565bd122d27f06241d1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.467402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c88d0a49e14565bd122d27f06241d1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.475009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.534277 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2516ae05a84f3fbd77bed1a7c7eaf5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.557850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2516ae05a84f3fbd77bed1a7c7eaf5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.558110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2516ae05a84f3fbd77bed1a7c7eaf5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.558773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2516ae05a84f3fbd77bed1a7c7eaf5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.564161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c88d0a49e14565bd122d27f06241d1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.566857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2516ae05a84f3fbd77bed1a7c7eaf5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.586530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c88d0a49e14565bd122d27f06241d1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.591407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c88d0a49e14565bd122d27f06241d1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.592120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 899/1791] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/users/aa2516ae05a84f3fbd77bed1a7c7eaf5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:47.592702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c88d0a49e14565bd122d27f06241d1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.594033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.596835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.621038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a7e22de0-968e-4cb3-b063-8b39ee425fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c88d0a49e14565bd122d27f06241d1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.638245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 893/1792] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/users/a6c88d0a49e14565bd122d27f06241d1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:47.639559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.639854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.640134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.666056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:47.667482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.713972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595c1c-7d3b-4cc2-b3bd-36f83cf83421 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.796634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 894/1793] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:47.810713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.811652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.811947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.812266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] PATH_INFO: `/v3/users/9ce5dc9a31a44eee88860903dcd18e32` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.813779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce5dc9a31a44eee88860903dcd18e32)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.815496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:47.816673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.816988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:47.896548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce5dc9a31a44eee88860903dcd18e32'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.910370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcd8b0-93ae-44cc-9b28-8a9602bc6d6d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:47.916230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:47.917428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.917428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.917898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:47.919545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce5dc9a31a44eee88860903dcd18e32'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.920517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce5dc9a31a44eee88860903dcd18e32'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.923853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce5dc9a31a44eee88860903dcd18e32'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.937533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce5dc9a31a44eee88860903dcd18e32'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:47.940174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:47.942048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1f22f-ccb8-482e-b714-47f0729d8445 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:47.968645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 895/1794] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:47.968780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 900/1795] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:47 2022] DELETE /identity/v3/users/9ce5dc9a31a44eee88860903dcd18e32 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:47.979118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:47.979416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:47.979799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:48.013062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:48.014782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:48.125341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 896/1796] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:48.161072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:48.162470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:48.278612 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e6695-131d-4397-8686-57fd1f43f950 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:48.284136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:48.285216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:48.285648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:48.286122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:48.311435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:48.313402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:48.330301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 901/1797] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:48.934717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:48.936184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:48.950793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab1a1-2989-4d2b-a9f8-01f197797a12 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:48.956888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:48.958439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:48.958934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:48.959450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] PATH_INFO: `/v3/projects/5039b93440a34759a1367f88d6ef415b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:48.961070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5039b93440a34759a1367f88d6ef415b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:48.963263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.018747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.020228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.033690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5039b93440a34759a1367f88d6ef415b', 'request_id': 'req-ecac3583-09ce-4d35-b165-e5c9197cef39'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.037606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b887450-1f4b-46bf-b2bb-db99ef042119 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.042844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5039b93440a34759a1367f88d6ef415b', 'request_id': 'req-ecac3583-09ce-4d35-b165-e5c9197cef39'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.072108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5039b93440a34759a1367f88d6ef415b', 'request_id': 'req-ecac3583-09ce-4d35-b165-e5c9197cef39'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.115759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] The token cache is being invalidate because project 5039b93440a34759a1367f88d6ef415b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:49.119414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.120868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ecac3583-09ce-4d35-b165-e5c9197cef39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.127665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 897/1798] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:48 2022] DELETE /identity/v3/projects/5039b93440a34759a1367f88d6ef415b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:49.129737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.130094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.130378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.164626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:49.166648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.192738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.194183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.194665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.195131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] PATH_INFO: `/v3/projects/b23c944c851f43c697b2f55d335a6c78` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.196477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23c944c851f43c697b2f55d335a6c78)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.198530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.259855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23c944c851f43c697b2f55d335a6c78', 'request_id': 'req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.267853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23c944c851f43c697b2f55d335a6c78', 'request_id': 'req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.277937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23c944c851f43c697b2f55d335a6c78', 'request_id': 'req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.291847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] The token cache is being invalidate because project b23c944c851f43c697b2f55d335a6c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:49.292476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.293182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.295489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 902/1799] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:49 2022] DELETE /identity/v3/projects/b23c944c851f43c697b2f55d335a6c78 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:49.296815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.298712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.305316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 898/1800] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:49.305908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.307512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.323405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84104d29-f63f-43e6-bbe3-87edfb66eec4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.392857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f764fd-f50e-44f3-9566-6f5b4c1c0fec admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.398543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.399433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.399684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.399956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] PATH_INFO: `/v3/projects/ab3b8b705b3d429e87cde0438ff73dea` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.401307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3b8b705b3d429e87cde0438ff73dea)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.403234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.405811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.406702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.406994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.407276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] PATH_INFO: `/v3/users/cf44e088498b484d843effa10ac18d09` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.409358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf44e088498b484d843effa10ac18d09)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.411314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.477280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3b8b705b3d429e87cde0438ff73dea', 'request_id': 'req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.484963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf44e088498b484d843effa10ac18d09'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.487803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3b8b705b3d429e87cde0438ff73dea', 'request_id': 'req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.503760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf44e088498b484d843effa10ac18d09'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.504466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf44e088498b484d843effa10ac18d09'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.505245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf44e088498b484d843effa10ac18d09'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.507390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3b8b705b3d429e87cde0438ff73dea', 'request_id': 'req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.524849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf44e088498b484d843effa10ac18d09'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.532440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] The token cache is being invalidate because project ab3b8b705b3d429e87cde0438ff73dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:49.532729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.533415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3dcfdd53-95b6-4b69-9e58-ba0a037f23b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.535247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 903/1801] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:49 2022] DELETE /identity/v3/projects/ab3b8b705b3d429e87cde0438ff73dea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:49.539384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.539669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.539980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.547052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 899/1802] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:49 2022] DELETE /identity/v3/users/cf44e088498b484d843effa10ac18d09 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:49.549561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.551765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.563580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:49.565232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:49.666273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930c537-9358-47f2-983b-aa97c5be7329 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.683227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.684456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.684890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.685314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] PATH_INFO: `/v3/users/0c7580be16064d229d50d98aae61ae35` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.687980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 904/1803] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:49.689034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7580be16064d229d50d98aae61ae35)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.691927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.694746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.705001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145961d-b888-4d56-bbe6-30b2f1885bec None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.718745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.721005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.721476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.721886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.724789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:49.725292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.727987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.769106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 905/1804] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:49.776179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.793435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582d118-3710-4f98-b4af-c8d264dad703 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:49.801025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:49.802732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:49.803513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:49.804009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:49.805390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:49.808336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:49.808789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7580be16064d229d50d98aae61ae35'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.867134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7580be16064d229d50d98aae61ae35'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.871834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7580be16064d229d50d98aae61ae35'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.876062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7580be16064d229d50d98aae61ae35'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.876335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 906/1805] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:49 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:49.888515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7580be16064d229d50d98aae61ae35'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:49.890781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:49.907745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 900/1806] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:49 2022] DELETE /identity/v3/users/0c7580be16064d229d50d98aae61ae35 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:49.907937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.062074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71afed-bcce-46ea-95b4-7ef1c99dac95 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.180381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.183129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.186692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.187520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.188043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.188456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.189307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.192237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.202806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f38b22-778c-4a1a-a020-9fdb4db80696 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.209865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.211403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.211881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.212636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] PATH_INFO: `/v3/projects/3d62c9e6c5a14f32889d4b60d03b2538` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.214506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d62c9e6c5a14f32889d4b60d03b2538)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.216848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.255961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 907/1807] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:49 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:50.262776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.288834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04864-19f8-4a76-9a16-d4ff225021ea admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.322532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d62c9e6c5a14f32889d4b60d03b2538', 'request_id': 'req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.362273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d62c9e6c5a14f32889d4b60d03b2538', 'request_id': 'req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.380392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d62c9e6c5a14f32889d4b60d03b2538', 'request_id': 'req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.384104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.384917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.385265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.385608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.386476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.388158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.408759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] The token cache is being invalidate because project 3d62c9e6c5a14f32889d4b60d03b2538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:50.409054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.414879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.414879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 901/1808] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:50 2022] DELETE /identity/v3/projects/3d62c9e6c5a14f32889d4b60d03b2538 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:50.415914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.417071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 908/1809] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:50.417411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.419235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.422523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.440215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8050fc7-7fe4-4d47-be2d-02023e4f84b3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.448770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87cce7-196e-4a09-971f-fc0725733c0c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.452582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.453998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.454896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.455232 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] PATH_INFO: `/v3/users/07ac4b52d49d451f83c00e71b5d0762f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.458400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ac4b52d49d451f83c00e71b5d0762f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.462682 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.465445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.466501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.466981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.467403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.469899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.474470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.503642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 909/1810] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:50.510137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.541642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a218a-44c9-4eaf-b0b3-0b2a219c9467 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.554339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.555365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.557413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.558077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] PATH_INFO: `/v3/projects/a292afd551064574871d833537da269e/users/808ce0247d384728a0c60114268fe8fb/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.590424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ac4b52d49d451f83c00e71b5d0762f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.604718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a292afd551064574871d833537da269e, user_id=808ce0247d384728a0c60114268fe8fb, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.608124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:50.616030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ac4b52d49d451f83c00e71b5d0762f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.617523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ac4b52d49d451f83c00e71b5d0762f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.618213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ac4b52d49d451f83c00e71b5d0762f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.634153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b9c81535-9ffa-4a4b-9721-9835064a9cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ac4b52d49d451f83c00e71b5d0762f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:50.646695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 910/1811] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:50 2022] PUT /identity/v3/projects/a292afd551064574871d833537da269e/users/808ce0247d384728a0c60114268fe8fb/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:50.648769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.653148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.670082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 902/1812] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:50 2022] DELETE /identity/v3/users/07ac4b52d49d451f83c00e71b5d0762f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:50.671983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.672374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.689324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.766382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] MFA Rules not processed for user `808ce0247d384728a0c60114268fe8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:50.768703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.812786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9742a1-4dcc-45c6-839b-2b41abad3053 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:50.906979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 903/1813] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:50.912055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:50.914971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:50.946145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:50.946963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:50.947737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:50.948435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] PATH_INFO: `/v3/projects/52f9eb3996274b52a449e70f5e3e8e99` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:50.950435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f9eb3996274b52a449e70f5e3e8e99)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:50.953313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.016620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be743f4a-e7de-45b4-88a2-886abd374f47 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.026975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f9eb3996274b52a449e70f5e3e8e99', 'request_id': 'req-a37c0e60-084c-43e7-b6b4-c87ebb513810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.039364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f9eb3996274b52a449e70f5e3e8e99', 'request_id': 'req-a37c0e60-084c-43e7-b6b4-c87ebb513810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.052052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f9eb3996274b52a449e70f5e3e8e99', 'request_id': 'req-a37c0e60-084c-43e7-b6b4-c87ebb513810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.069705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] The token cache is being invalidate because project 52f9eb3996274b52a449e70f5e3e8e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:51.070230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.071080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a37c0e60-084c-43e7-b6b4-c87ebb513810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.076058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 911/1814] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:50 2022] DELETE /identity/v3/projects/52f9eb3996274b52a449e70f5e3e8e99 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:51.077793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.078165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.078666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.101024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:51.102229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.137698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.138512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.140907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.140907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.140907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.141913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.190631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 904/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:50 2022] POST /identity/v3/projects => generated 387 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:51.191760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.195238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.227425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 912/1816] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:51.229475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.242009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.261178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a668-8a66-4221-a41b-26db44515dd1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.289881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004828ff-e83b-434e-8305-f173dfe69d62 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.295060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.295942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.296460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.296751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] PATH_INFO: `/v3/projects/58dd7b5ef925453d9404b4f7557ea13c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.297974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dd7b5ef925453d9404b4f7557ea13c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.299936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.332550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.333305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.333590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.333869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.334643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.337072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c047dcb-2637-44dd-a44d-316b8d32f932 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.365009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 913/1817] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:51.370119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602bb4-5546-4a8b-a0d2-c9799e89aab9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.370420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602bb4-5546-4a8b-a0d2-c9799e89aab9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.370705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d602bb4-5546-4a8b-a0d2-c9799e89aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.374789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dd7b5ef925453d9404b4f7557ea13c', 'request_id': 'req-21615995-5b76-4745-bedf-6d67510d34a6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.400237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-3d602bb4-5546-4a8b-a0d2-c9799e89aab9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:51.401596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3d602bb4-5546-4a8b-a0d2-c9799e89aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.405098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dd7b5ef925453d9404b4f7557ea13c', 'request_id': 'req-21615995-5b76-4745-bedf-6d67510d34a6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.423186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dd7b5ef925453d9404b4f7557ea13c', 'request_id': 'req-21615995-5b76-4745-bedf-6d67510d34a6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.443592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] The token cache is being invalidate because project 58dd7b5ef925453d9404b4f7557ea13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:51.443962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.444846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:51.450922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 905/1818] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:51 2022] DELETE /identity/v3/projects/58dd7b5ef925453d9404b4f7557ea13c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:51.450922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.453964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.510077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 914/1819] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:51.511944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.512371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.512740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.548929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:51.554468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.565473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 915/1820] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:51.566633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.595916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb933fc-3f8a-44bc-96fb-a4945ad765e3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.603304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.604079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.604678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.604922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.605923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:51.606330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.608427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00c1c6-d0e9-4e20-8207-ee5bef2ce5d3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.623453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 916/1821] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:51.628370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.628647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.628992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.631591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615995-5b76-4745-bedf-6d67510d34a6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.637761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.638568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.638853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.639129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.640252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.641632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.654926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 906/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:51.659371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.671621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf14acc-c256-4500-86f2-8af63833c2ff admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.675305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:51.677787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:51.678010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.678733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.679023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.679306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.680008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.682273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.690697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 917/1823] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:51.692314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.705726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461b0c5-cd63-4ba4-9c1a-23661cfd767f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.716721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.718416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.719885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.720441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] PATH_INFO: `/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b/users/b031314deb104b9db24c4674dc3a55e0/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.726951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 907/1824] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:51.732109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.752626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ad091fc09f4b5eb154a600a703fb9b, user_id=b031314deb104b9db24c4674dc3a55e0, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.757368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.778636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 918/1825] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:51 2022] PUT /identity/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b/users/b031314deb104b9db24c4674dc3a55e0/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:51.779615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.845147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00a4be-5a82-48d4-9c59-0bee2248de21 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.881024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c1f89-ea46-474b-8668-be9166e5704d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.887420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.889030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.889496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.889827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.890907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.893271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.950304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 919/1826] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:51 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:51.951385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:51.978827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36df7ac-61a3-4f4e-af23-857e849163a4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:51.983001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.984198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:51.984353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.984882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.985267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.985468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:51.985948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:51.986361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:51.986564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:51.986974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.987539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:51.989034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:51.991427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.019558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 920/1827] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:52.019558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.029913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 908/1828] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:52.034510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.038344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf760-7e73-4a67-b7ce-ef8a11ffa4a5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.043440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.045170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.045460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.045736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.046709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.048994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.062733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f8b14-68e7-4e74-b732-e34780503832 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.063664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 921/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:52.065463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.077398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.078926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.079061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f808-b69c-48de-ba90-b77768f75edf admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.079410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.079507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] PATH_INFO: `/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b/users/b031314deb104b9db24c4674dc3a55e0/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.085295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.086268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.086473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.086685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.087375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ad091fc09f4b5eb154a600a703fb9b, user_id=b031314deb104b9db24c4674dc3a55e0, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.087499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.089444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e39b5-3183-4880-8b8c-5e7742996a53 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.090237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.128899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 909/1830] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:52 2022] PUT /identity/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b/users/b031314deb104b9db24c4674dc3a55e0/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:52.128899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.168184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 922/1831] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:52.170566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.171033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.171479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.212649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] MFA Rules not processed for user `b031314deb104b9db24c4674dc3a55e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:52.213955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:52.218748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c7a74-28cb-45bd-b79a-24d8e2b7b5d9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.305754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.307216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.307705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.308197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.309739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.313234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.316315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 923/1832] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:52.317176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.328953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 910/1833] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:52.329236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b38c-c326-4d60-8f77-6dc89bd77c24 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.333334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.335866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.336640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.336932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.337207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.337909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.340353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.347203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cd1e1-25e6-4836-b708-f639cdb49511 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.354538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.356372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.356913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.357523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] PATH_INFO: `/v3/projects/ac7fd95fa02544ba88a7ee43256ec0de/users/b23bb0eba1264ba7ae9f049d0590e2cb/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.375374 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 924/1834] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/users => generated 300 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:52.376101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.383711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:52.388200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7fd95fa02544ba88a7ee43256ec0de, user_id=b23bb0eba1264ba7ae9f049d0590e2cb, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.392731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.412770 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 911/1835] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:52 2022] PUT /identity/v3/projects/ac7fd95fa02544ba88a7ee43256ec0de/users/b23bb0eba1264ba7ae9f049d0590e2cb/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:52.413844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.491888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bd02e-73d6-4f7f-a746-bebefbd59c9d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.556236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bd50e-7749-4937-81e8-5bc680df3e79 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.561586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.562681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.563685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.564214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.565082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.566867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bde391-5886-47e3-9b0b-2ceb56170244 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.580407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 912/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:52.581829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.582126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.582410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.606833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.607511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.607945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.608218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.616031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] MFA Rules not processed for user `b23bb0eba1264ba7ae9f049d0590e2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:52.617708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:52.732509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 913/1837] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:52.733533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.748460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119ab85-b231-44ea-9be3-aa909a8b10de None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.753594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.754520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.754809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.755114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.755912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.758494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.759059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.760785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.770241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 914/1838] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:52.771181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.771868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 925/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:52.775966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.785448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f18d3-3a27-42ce-aee9-72545b41e564 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.788207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bf454-a2d0-4be1-b20a-9d53cfd29b02 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.793585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.793952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.794593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.794851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.794958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.795135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.795235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.795414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] PATH_INFO: `/v3/projects/add53ea798d24422ba9fe3d44d81de79/users/9bcd4b2be03741c088fc7afcb2646080/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.795830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.797784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.815757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add53ea798d24422ba9fe3d44d81de79, user_id=9bcd4b2be03741c088fc7afcb2646080, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.818721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5601b51-1fcd-4a11-98fa-c9a71ea0e222 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:52.832691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 915/1840] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:52.837214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.852390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 926/1841] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:52 2022] PUT /identity/v3/projects/add53ea798d24422ba9fe3d44d81de79/users/9bcd4b2be03741c088fc7afcb2646080/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:52.862373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.862671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.862958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.895078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] MFA Rules not processed for user `9bcd4b2be03741c088fc7afcb2646080`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:52.896310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:52.915899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89607c-f007-4cf6-82b0-53a207f3cfc8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:52.971855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 927/1842] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:52.972644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:52.977584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:52.978270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:52.978558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:52.978842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:52.979540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:52.981515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.009120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 916/1843] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:52 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:53.009120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.016849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a2a-ae72-452c-b849-3eaa45b3377b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.021921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.022943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.023277 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.023543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.024392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.026336 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.040418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143077a3-0cf4-4b43-9daa-4bb41d1d5cdc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.045811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.047238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.047599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.047878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] PATH_INFO: `/v3/users/808ce0247d384728a0c60114268fe8fb` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.049163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808ce0247d384728a0c60114268fe8fb)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.051375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.054972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 917/1844] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:53 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:53.057223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.105397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808ce0247d384728a0c60114268fe8fb'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:53.119276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808ce0247d384728a0c60114268fe8fb'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:53.120308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808ce0247d384728a0c60114268fe8fb'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:53.120928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986f49-bbf7-4da6-bace-6a4f0335c171 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.121065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808ce0247d384728a0c60114268fe8fb'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:53.126073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.127028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.127028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.127288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.128454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.130184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.132313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808ce0247d384728a0c60114268fe8fb'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:53.144041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 918/1845] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:53.144629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.146372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.151106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 928/1846] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:52 2022] DELETE /identity/v3/users/808ce0247d384728a0c60114268fe8fb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:53.152119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.154500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.166727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5563b2-ba3c-471d-af4b-e4865702e72a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.233791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.234432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.234432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.234593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.235172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.238461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e821a9-17c0-4657-b64f-789883a34528 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.238838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bc9af-40d8-44f9-8c02-a362e10bfcd1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.246621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.247666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.248050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.248466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] PATH_INFO: `/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7/users/73b83d523a0c40fabf84aa3e53ef3fc5/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.267122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 919/1847] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:53 2022] POST /identity/v3/users => generated 306 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:53.268715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.268992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.269274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.277472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a266da7e8da6451ba94eb3458aa8f5d7, user_id=73b83d523a0c40fabf84aa3e53ef3fc5, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.286408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.294641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:53.295918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.309214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 920/1848] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:53.313125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.324008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb569150-fe8d-4593-ae62-c5c94e82e5d1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.324717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 929/1849] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:53 2022] PUT /identity/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7/users/73b83d523a0c40fabf84aa3e53ef3fc5/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:53.325383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.328669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.388909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa79801-1587-4246-be19-ce7125bfd5e3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.392713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.393357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.393636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.393739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.393911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.394351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.394633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.394908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.395629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.397359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.403430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.404947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.407434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 921/1850] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:53.408267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.416451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 930/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:53.417306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.418489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842c98f-0d28-4d51-affe-ad4b2cc9f98d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.423096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.423764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.424044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.424412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.425063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.426927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.427340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d38ea-4847-476b-9b2d-2ffa6bbb328d service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.433656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.434411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.434693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.434966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] PATH_INFO: `/v3/projects/f0ad099e32d24802bf6c0e7a84b10431/users/9d084c1e3ae745cda895cff4f1c986ed/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.438922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 922/1852] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:53.442878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.454758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ad099e32d24802bf6c0e7a84b10431, user_id=9d084c1e3ae745cda895cff4f1c986ed, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.457554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.459155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f56301-a9ca-4e7a-9fa7-5bb005e62467 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.465031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.466044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.466235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.466568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] PATH_INFO: `/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7/users/73b83d523a0c40fabf84aa3e53ef3fc5/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.469879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a266da7e8da6451ba94eb3458aa8f5d7, user_id=73b83d523a0c40fabf84aa3e53ef3fc5, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.472892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843b9f9-19ef-4592-80e6-606cea312fe4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.477849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 931/1853] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:53 2022] PUT /identity/v3/projects/f0ad099e32d24802bf6c0e7a84b10431/users/9d084c1e3ae745cda895cff4f1c986ed/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:53.483035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.490532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 923/1854] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:53 2022] PUT /identity/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7/users/73b83d523a0c40fabf84aa3e53ef3fc5/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:53.505089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.505313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.505578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.534988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] MFA Rules not processed for user `73b83d523a0c40fabf84aa3e53ef3fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:53.536787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.581982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec1b9-279b-4c30-85f7-8e451264a3d5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.633332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 924/1855] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:53.644679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.646655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.649433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.650050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.650341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.650619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.651351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.653015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.668593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 932/1856] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:53.670608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.685229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1f34f-73b3-4731-82d0-3e00e702d3e6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.693754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.695729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.696350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.697101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] PATH_INFO: `/v3/projects/f0ad099e32d24802bf6c0e7a84b10431/users/9d084c1e3ae745cda895cff4f1c986ed/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.699628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ad099e32d24802bf6c0e7a84b10431, user_id=9d084c1e3ae745cda895cff4f1c986ed, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.703838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3afcf-1e4d-4f99-b259-db98ec876523 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.717048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 933/1857] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:53 2022] PUT /identity/v3/projects/f0ad099e32d24802bf6c0e7a84b10431/users/9d084c1e3ae745cda895cff4f1c986ed/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:53.717244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4da27-dd38-408c-8f66-6c778aa46f06 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:53.728181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.728503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.728840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.770988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] MFA Rules not processed for user `9d084c1e3ae745cda895cff4f1c986ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:53.773052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.841432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:53.841945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:53.842237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:53.842514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:53.903003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 934/1858] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:53.904199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:53.905771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:53.953619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:53.956035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:53.977771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 925/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:54.003106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92123-cf39-4701-85d7-be1350ca25d9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:54.009268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:54.010102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.010391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.010672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] PATH_INFO: `/v3/projects/a292afd551064574871d833537da269e` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.012012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a292afd551064574871d833537da269e)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:54.014059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:54.065861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:54.079193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214952-e967-47a1-87bb-6bcbc051acdf service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:54.096468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a292afd551064574871d833537da269e', 'request_id': 'req-99ccbece-9bd1-4c5c-bd5b-90f061165212'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.105743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a292afd551064574871d833537da269e', 'request_id': 'req-99ccbece-9bd1-4c5c-bd5b-90f061165212'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.116054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a292afd551064574871d833537da269e', 'request_id': 'req-99ccbece-9bd1-4c5c-bd5b-90f061165212'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.134016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] The token cache is being invalidate because project a292afd551064574871d833537da269e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:54.134016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.134016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.134977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 935/1860] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:53 2022] DELETE /identity/v3/projects/a292afd551064574871d833537da269e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:54.138933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:54.141234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:54.165445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:54.166113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.166389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.166657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.168640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:54.228836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccbece-9bd1-4c5c-bd5b-90f061165212 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:54.236462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:54.237173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.237516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.237805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] PATH_INFO: `/v3/users/b031314deb104b9db24c4674dc3a55e0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.239345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b031314deb104b9db24c4674dc3a55e0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:54.242094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:54.245922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:54.247616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:54.258595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 926/1861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:54.326872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b031314deb104b9db24c4674dc3a55e0'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.344085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b031314deb104b9db24c4674dc3a55e0'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.344859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b031314deb104b9db24c4674dc3a55e0'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.345795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b031314deb104b9db24c4674dc3a55e0'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.354577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b031314deb104b9db24c4674dc3a55e0'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.369974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 936/1862] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:54 2022] DELETE /identity/v3/users/b031314deb104b9db24c4674dc3a55e0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:54.520727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:54.522353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:54.537351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4347d-5913-4b60-9636-7410bf80b22f service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:54.597276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:54.597970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.598279 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.598887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.603961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:54.672225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:54.674047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc24bf-27af-45dd-b68f-6ced31a135e5 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:54.686987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 927/1863] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:54.763218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:54.764860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:54.844773 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3666-a155-4874-b870-18de6d6eb694 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:54.850665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:54.851598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.851886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.852163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] PATH_INFO: `/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.853671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ad091fc09f4b5eb154a600a703fb9b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:54.855622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:54.911179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ad091fc09f4b5eb154a600a703fb9b', 'request_id': 'req-296a747b-26cc-4ecf-af33-cdb165ebce4a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.918278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ad091fc09f4b5eb154a600a703fb9b', 'request_id': 'req-296a747b-26cc-4ecf-af33-cdb165ebce4a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.926396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ad091fc09f4b5eb154a600a703fb9b', 'request_id': 'req-296a747b-26cc-4ecf-af33-cdb165ebce4a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.941192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] The token cache is being invalidate because project f4ad091fc09f4b5eb154a600a703fb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:54.941511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.942212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-296a747b-26cc-4ecf-af33-cdb165ebce4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:54.944701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 937/1864] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:54 2022] DELETE /identity/v3/projects/f4ad091fc09f4b5eb154a600a703fb9b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:54.949722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:54.950033 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:54.950298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:54.968864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:54.970133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.060362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 928/1865] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:55.066585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.067435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.068028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.101328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:55.102651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.112306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 938/1866] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:55.116712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.127038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cccfa1-4b9f-4d98-ba6c-c7e7f1fd0af2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.132727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.133424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.133707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.134005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.134727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:55.135040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.136822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.151259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 929/1867] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:55.155938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.166812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df397f83-e547-43ad-a94c-b1855baa46e2 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.172093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.172976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.173386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.173661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.174469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.177229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.207977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 939/1868] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:55.214061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.231060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f8ed0-2a6d-4175-8011-e58bb4001048 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.306465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.307196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.307439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.307720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.308538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.310811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.347026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 930/1869] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:55.348730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.359320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63573008-f26f-49de-bfd4-5a1748e7b0cc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.364201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.364915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.365196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.365471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.366696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.368331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.382825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 940/1870] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:55.384048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.393943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ee25a-8d09-4a79-a9ea-a008d91cc389 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.399969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.400700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.401145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.401424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.402373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.404249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca38aa0-eb33-4fe6-901d-1e19aaa6757c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.415829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 931/1871] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:55.421004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.432670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb36f3c-ab9b-40ba-a2d1-c1fd420bda88 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.440256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.441430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.441734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.442131 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] PATH_INFO: `/v3/projects/f4fe641298e84260a43b19b9f8b514ae/users/2d42199962084484bffcefab925cd14d/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.460170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fe641298e84260a43b19b9f8b514ae, user_id=2d42199962084484bffcefab925cd14d, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.462707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.477600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 941/1872] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:55 2022] PUT /identity/v3/projects/f4fe641298e84260a43b19b9f8b514ae/users/2d42199962084484bffcefab925cd14d/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:55.490303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.491271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.491695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.541597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] MFA Rules not processed for user `2d42199962084484bffcefab925cd14d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:55.542951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.637114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 932/1873] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:55.642016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.725419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b86441-b743-4955-9ecf-9a2971c86af8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.730981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.731730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.732066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.732423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.733210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.735182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.736737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.738088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.751797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e69c72-1243-4da9-9df7-5199f951df64 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.757699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.758583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.758866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.759138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] PATH_INFO: `/v3/users/b23bb0eba1264ba7ae9f049d0590e2cb` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.760377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23bb0eba1264ba7ae9f049d0590e2cb)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.762321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.768917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 942/1874] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:55.774061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.840764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23bb0eba1264ba7ae9f049d0590e2cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.855908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69970dba-203d-4733-a372-d39f01afdfbd admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.857738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23bb0eba1264ba7ae9f049d0590e2cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.858451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23bb0eba1264ba7ae9f049d0590e2cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.859083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23bb0eba1264ba7ae9f049d0590e2cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.861455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.862182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.862472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.862762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.863526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.865745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.867656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a13e8460-658d-468b-bc0a-d47fe434d7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23bb0eba1264ba7ae9f049d0590e2cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:55.884301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 933/1875] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:55 2022] DELETE /identity/v3/users/b23bb0eba1264ba7ae9f049d0590e2cb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:55.889065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.889360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.889643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.892932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 943/1876] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:48:55.896682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.898784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.913159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48e34-f53a-4429-92c9-d9c77f692c9c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:55.914363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:55.915584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:55.980077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:55.980829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:55.981121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:55.981393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:55.985229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:55.985367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 934/1877] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:55.985534 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:55.991685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:55.993635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.002609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 944/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:48:56.004536 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.014666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b61ea-5440-4723-b57a-834ad2bfa155 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.019343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.020169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.020511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.020787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] PATH_INFO: `/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527/users/c477d0cd702340b2b0fb718fa88c44e3/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.038852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a685f4826f948ebbc6ecdf9fd16a527, user_id=c477d0cd702340b2b0fb718fa88c44e3, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.041571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.055535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c2f48-3cf7-4f75-a4f7-4a302400ea48 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.057376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 945/1879] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:56 2022] PUT /identity/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527/users/c477d0cd702340b2b0fb718fa88c44e3/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:56.061998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.110201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.110866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.111150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.112321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.138704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68033396-def7-4014-a482-0bb0c33dfbd6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.144847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.145586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.145860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.146097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.147333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.149040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.167717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 946/1880] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:56.171805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.182940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08b1cc-f5e4-4d3f-b02f-eb5e83e8ac65 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.194341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.196068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.196383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.196670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] PATH_INFO: `/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527/users/c477d0cd702340b2b0fb718fa88c44e3/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.198804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a685f4826f948ebbc6ecdf9fd16a527, user_id=c477d0cd702340b2b0fb718fa88c44e3, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.202971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a02cdd-243e-4721-a854-f5f0041e575c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.218670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 947/1881] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:56 2022] PUT /identity/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527/users/c477d0cd702340b2b0fb718fa88c44e3/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:56.231107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.231419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.231825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.232313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.232945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.245385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 935/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:56.265871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] MFA Rules not processed for user `c477d0cd702340b2b0fb718fa88c44e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:56.267101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.355932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 948/1883] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:48:56.372726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.375064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.463937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abec5b-8e70-42c8-ab9e-c9545d16676f service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.554898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.556069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.556595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.557175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.559507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.660409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.662299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:56.674254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 936/1884] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:48:56.794279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:56.796938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:56.921962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce447-8603-4046-8f90-6f0dfac8b54b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:56.927563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:56.929000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:56.930558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:56.931083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] PATH_INFO: `/v3/projects/ac7fd95fa02544ba88a7ee43256ec0de` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:56.932675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7fd95fa02544ba88a7ee43256ec0de)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:56.935403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.000189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7fd95fa02544ba88a7ee43256ec0de', 'request_id': 'req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.009756 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7fd95fa02544ba88a7ee43256ec0de', 'request_id': 'req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.029936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7fd95fa02544ba88a7ee43256ec0de', 'request_id': 'req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.050758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] The token cache is being invalidate because project ac7fd95fa02544ba88a7ee43256ec0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:57.051404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.052132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.058038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 949/1885] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:56 2022] DELETE /identity/v3/projects/ac7fd95fa02544ba88a7ee43256ec0de => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:57.059361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.071777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0fe47-3f88-4652-a107-2a97aeca6be4 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.166886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.169091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.169486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.170207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] PATH_INFO: `/v3/users/73b83d523a0c40fabf84aa3e53ef3fc5` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.171774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b83d523a0c40fabf84aa3e53ef3fc5)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:57.174748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:57.261725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b83d523a0c40fabf84aa3e53ef3fc5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.285720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b83d523a0c40fabf84aa3e53ef3fc5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.286932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b83d523a0c40fabf84aa3e53ef3fc5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.288517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b83d523a0c40fabf84aa3e53ef3fc5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.298110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-36a832ff-27c4-44c5-8fe7-897dc0e4cba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b83d523a0c40fabf84aa3e53ef3fc5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:57.325966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 937/1886] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:57 2022] DELETE /identity/v3/users/73b83d523a0c40fabf84aa3e53ef3fc5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:57.825722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:57.827409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:57.851909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e338b-7a1e-4a27-a9f6-f1d1fbc8d456 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:57.989916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:57.992702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:57.992991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:57.993859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] PATH_INFO: `/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:57.995671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a266da7e8da6451ba94eb3458aa8f5d7)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.002411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.083703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a266da7e8da6451ba94eb3458aa8f5d7', 'request_id': 'req-68c46b9b-936a-49cd-946b-52fc2220af4e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:58.090574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a266da7e8da6451ba94eb3458aa8f5d7', 'request_id': 'req-68c46b9b-936a-49cd-946b-52fc2220af4e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:58.098899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a266da7e8da6451ba94eb3458aa8f5d7', 'request_id': 'req-68c46b9b-936a-49cd-946b-52fc2220af4e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:58.110399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] The token cache is being invalidate because project a266da7e8da6451ba94eb3458aa8f5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:48:58.110691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:58.111398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-68c46b9b-936a-49cd-946b-52fc2220af4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:58.113102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 950/1887] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:48:57 2022] DELETE /identity/v3/projects/a266da7e8da6451ba94eb3458aa8f5d7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:58.119951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.120521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.120521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.140328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:58.141542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.217572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 938/1888] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:58.219859 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.220256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.220918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.245654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:58.246880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.255168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 951/1889] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:58.259513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.269660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce0425-1683-4851-9e04-6979c4fe985e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.274586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.275343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.275697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.276066 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.276947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:48:58.277354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.279059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.296452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 939/1890] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:48:58.298907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.311444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c6fa-ec8d-4b9f-980a-3da3aa21e180 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.316840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.317753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.318229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.318783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.321182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.322237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.354784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 952/1891] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:58.359654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.371079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41905a-bfeb-43e7-b334-820499f0896f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.461171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.462075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.463058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.463530 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.464434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.466734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.499582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 940/1892] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:48:58.503990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.517738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e46a-5931-4c2a-8209-f2267888d90d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.523197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.524563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.525248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.525604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.526521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.530176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.552174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 953/1893] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:58.552468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.564386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eee936-f6f2-49f6-9626-50f36cc10c56 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.589961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.590666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.591765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.591765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.592469 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.594384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9015c-d371-43bf-919d-0e644c12fc57 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.610297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 941/1894] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:48:58.610993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.627336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304f5c5-ad53-432e-b2ab-1d46b09a1437 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.637801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.639569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.639945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.640138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] PATH_INFO: `/v3/projects/d968e17fa36f403a923b7b42af28333d/users/0cc5e5dfa3bb45c6bf8c4fcfcaadceec/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.670703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d968e17fa36f403a923b7b42af28333d, user_id=0cc5e5dfa3bb45c6bf8c4fcfcaadceec, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:58.678394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:58.708370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 954/1895] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:48:58 2022] PUT /identity/v3/projects/d968e17fa36f403a923b7b42af28333d/users/0cc5e5dfa3bb45c6bf8c4fcfcaadceec/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:58.712736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.713347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:58.713843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:58.765119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:58.768855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.914792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.917997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.963329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 942/1896] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:58.974496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5ea98-ee00-4a4c-abfe-412c8e3b13fe admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:58.980980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:58.983516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:58.986081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:58.998957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:58.999255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.000047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] PATH_INFO: `/v3/users/9bcd4b2be03741c088fc7afcb2646080` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.003021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcd4b2be03741c088fc7afcb2646080)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:59.012683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:59.115294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a68557-2aa5-4976-b812-a0443dac4e97 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:59.121508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:59.122591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.122841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.123592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.140783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:59.143054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74061ca8-dd24-4fc7-a8c5-424cda5d0cc5 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:59.148935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcd4b2be03741c088fc7afcb2646080'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.164815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 943/1897] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:59.174169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcd4b2be03741c088fc7afcb2646080'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.175531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcd4b2be03741c088fc7afcb2646080'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.176615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcd4b2be03741c088fc7afcb2646080'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.187550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcd4b2be03741c088fc7afcb2646080'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.212913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 955/1898] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:58 2022] DELETE /identity/v3/users/9bcd4b2be03741c088fc7afcb2646080 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:48:59.221169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.223895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.224073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.267216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:59.269595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:59.394065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 944/1899] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:59.422742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:59.425430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:59.483485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:59.485261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:59.499622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230532d8-e353-4582-85a6-9e371030e2cc None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:59.505886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:59.507064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.507379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.507661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] PATH_INFO: `/v3/users/1e056acdbda44e4c92ccc050d8161c2a` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.508952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e056acdbda44e4c92ccc050d8161c2a)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:59.511381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:59.515816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d916e-f79f-4d0e-bb44-5c5155b2bc57 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:59.519767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:59.520450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.520792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.521597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.541313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:59.542912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e67ad-e1b5-40a4-8571-c355e291e952 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:59.555935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 956/1900] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:48:59.566689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e056acdbda44e4c92ccc050d8161c2a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.579760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e056acdbda44e4c92ccc050d8161c2a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.580556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e056acdbda44e4c92ccc050d8161c2a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.581205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e056acdbda44e4c92ccc050d8161c2a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.588984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e056acdbda44e4c92ccc050d8161c2a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:48:59.604220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 945/1901] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:48:59 2022] DELETE /identity/v3/users/1e056acdbda44e4c92ccc050d8161c2a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:48:59.608727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.609020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.609301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.630973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:48:59.634724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:59.702012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 957/1902] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:48:59.718085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:48:59.720158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:48:59.783943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7284045-e6f5-415a-97ef-90687889e073 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:48:59.788853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:48:59.789528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:48:59.789811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:48:59.790088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:48:59.800822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:48:59.802547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:48:59.812939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 946/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:00.306373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:00.308354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:00.325404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bb058-8b28-4c89-b227-3ca1b985d654 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:00.331828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:00.333729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:00.335875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:00.339839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] PATH_INFO: `/v3/projects/8fa7e630b7904478a842fc3c4509dbf6` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:00.341141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:00.342561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:00.343178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa7e630b7904478a842fc3c4509dbf6)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:00.345486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:00.367238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c5cd5-dd40-4c94-a8fb-2b262f9a78bc service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:00.382852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:00.385191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:00.385641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:00.386069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] PATH_INFO: `/v3/projects/add53ea798d24422ba9fe3d44d81de79` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:00.389926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=add53ea798d24422ba9fe3d44d81de79)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:00.392079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:00.423904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa7e630b7904478a842fc3c4509dbf6', 'request_id': 'req-862cd155-5234-4480-88a4-8d4f05120ca5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.431418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa7e630b7904478a842fc3c4509dbf6', 'request_id': 'req-862cd155-5234-4480-88a4-8d4f05120ca5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.453122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa7e630b7904478a842fc3c4509dbf6', 'request_id': 'req-862cd155-5234-4480-88a4-8d4f05120ca5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.470638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] The token cache is being invalidate because project 8fa7e630b7904478a842fc3c4509dbf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:00.470638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.471328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.471820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add53ea798d24422ba9fe3d44d81de79', 'request_id': 'req-6d914494-5382-4931-aa99-0d4a943a56c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.480630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add53ea798d24422ba9fe3d44d81de79', 'request_id': 'req-6d914494-5382-4931-aa99-0d4a943a56c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.482243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 958/1904] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:00 2022] DELETE /identity/v3/projects/8fa7e630b7904478a842fc3c4509dbf6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:00.483344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:00.487152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:00.492461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add53ea798d24422ba9fe3d44d81de79', 'request_id': 'req-6d914494-5382-4931-aa99-0d4a943a56c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.510766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] The token cache is being invalidate because project add53ea798d24422ba9fe3d44d81de79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:00.511318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.512228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.522867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 947/1905] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:00 2022] DELETE /identity/v3/projects/add53ea798d24422ba9fe3d44d81de79 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:00.527681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:00.529586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:00.618426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cd155-5234-4480-88a4-8d4f05120ca5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:00.654760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d914494-5382-4931-aa99-0d4a943a56c1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:00.660456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:00.661365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:00.661656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:00.661939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] PATH_INFO: `/v3/users/9d084c1e3ae745cda895cff4f1c986ed` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:00.664149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d084c1e3ae745cda895cff4f1c986ed)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:00.666856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:00.781465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:00.781465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:00.781465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:00.781465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] PATH_INFO: `/v3/users/a308ae5914064ded8eac48282c319e80` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:00.786853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d084c1e3ae745cda895cff4f1c986ed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.788471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a308ae5914064ded8eac48282c319e80)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:00.795728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:00.842348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d084c1e3ae745cda895cff4f1c986ed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.843569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d084c1e3ae745cda895cff4f1c986ed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.845220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d084c1e3ae745cda895cff4f1c986ed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.855960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-da6804f1-3041-49b9-99c8-31874fee6c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d084c1e3ae745cda895cff4f1c986ed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.884938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 948/1906] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:00 2022] DELETE /identity/v3/users/9d084c1e3ae745cda895cff4f1c986ed => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:00.947003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:00.947471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:00.948128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:00.949710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a308ae5914064ded8eac48282c319e80'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.975412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a308ae5914064ded8eac48282c319e80'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.978961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a308ae5914064ded8eac48282c319e80'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.980503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a308ae5914064ded8eac48282c319e80'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:00.997917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a308ae5914064ded8eac48282c319e80'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.004310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] MFA Rules not processed for user `0cc5e5dfa3bb45c6bf8c4fcfcaadceec`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:01.005992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.021766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 959/1907] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:00 2022] DELETE /identity/v3/users/a308ae5914064ded8eac48282c319e80 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:01.114251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 949/1908] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:01.115241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:01.117415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.215904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d2350-558d-4015-bc3b-45dd0ffd33f2 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:01.228376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:01.229205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.229494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.229770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.317628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:01.319992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:01.330122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 960/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:01.421635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:01.423129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.447965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:01.449533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.564693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4bc5-6a76-47ab-953d-54483140f1c9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:01.570938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:01.572137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.572704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.573056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] PATH_INFO: `/v3/projects/f0ad099e32d24802bf6c0e7a84b10431` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.574633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ad099e32d24802bf6c0e7a84b10431)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:01.576805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:01.583154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba4d5-2475-4e6f-abe7-73a9a3974f00 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:01.591045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:01.592513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.592802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.593251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] PATH_INFO: `/v3/projects/9197cd1f221b4683add225ecac919773` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.594694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9197cd1f221b4683add225ecac919773)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:01.597301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:01.649031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ad099e32d24802bf6c0e7a84b10431', 'request_id': 'req-dc8e05b9-f266-4bb6-9056-c9ad175b294c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.657006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ad099e32d24802bf6c0e7a84b10431', 'request_id': 'req-dc8e05b9-f266-4bb6-9056-c9ad175b294c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.659154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9197cd1f221b4683add225ecac919773', 'request_id': 'req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.667779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ad099e32d24802bf6c0e7a84b10431', 'request_id': 'req-dc8e05b9-f266-4bb6-9056-c9ad175b294c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.669624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9197cd1f221b4683add225ecac919773', 'request_id': 'req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.683061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] The token cache is being invalidate because project f0ad099e32d24802bf6c0e7a84b10431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:01.683448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.685824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9197cd1f221b4683add225ecac919773', 'request_id': 'req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.686074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc8e05b9-f266-4bb6-9056-c9ad175b294c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.691505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 950/1910] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:01 2022] DELETE /identity/v3/projects/f0ad099e32d24802bf6c0e7a84b10431 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:01.699019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.699423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.699873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.714030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] The token cache is being invalidate because project 9197cd1f221b4683add225ecac919773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:01.715087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.715905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4c05a1dc-297d-4fa0-8b58-e9fb2e20d988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:01.717989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 961/1911] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:01 2022] DELETE /identity/v3/projects/9197cd1f221b4683add225ecac919773 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:01.723640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff63-ea45-4486-98cd-80bcc51224e5 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.723926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff63-ea45-4486-98cd-80bcc51224e5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.724205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659ff63-ea45-4486-98cd-80bcc51224e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.742584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:01.743819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.752890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b659ff63-ea45-4486-98cd-80bcc51224e5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:01.754387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b659ff63-ea45-4486-98cd-80bcc51224e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.829457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 962/1912] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:01.849361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7503ab0-bf2d-490e-b77a-8c2959cb91b6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.849938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7503ab0-bf2d-490e-b77a-8c2959cb91b6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.849938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7503ab0-bf2d-490e-b77a-8c2959cb91b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.852025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 951/1913] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:01.858689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:01.863825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.882086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a7503ab0-bf2d-490e-b77a-8c2959cb91b6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:01.883632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a7503ab0-bf2d-490e-b77a-8c2959cb91b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.893494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 963/1914] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:01.895107 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.895587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.896051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.925843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:01.927452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.942858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaeb98-c399-4076-8f29-79f81759a7fb None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:01.943061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 964/1915] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:01.943061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:01.946432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:01.947774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.948131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.949149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.950681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:01.956601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a5bd9-1564-443e-b3ba-59446d2db5f1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:01.963211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:01.969132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:01.969476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:01.969803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:01.971226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:01.971549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:01.973710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:01.995047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 965/1916] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:01.995047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.004435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ff7fc-cfe4-4a80-958a-ebd5f24fcee4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.010022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.010791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.011458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.011458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.012161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:02.012541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.014296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.022436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.023984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.034960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 952/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:02.035639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.060562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 966/1918] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:02.060651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0ea7f-6e88-4903-a285-2d54e05082c5 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.061918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.064865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.065718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.066200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.066600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.067670 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.070792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.079493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75592736-5c16-4d0a-8c92-fe6a0408eda0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.084492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.085344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.085655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.085934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.086689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.094653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.105076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 953/1919] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/projects => generated 357 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:02.108923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.135011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 967/1920] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:02.138305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.193456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36e96d-b9d3-48f6-b265-eaab426b8409 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.218186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbafb4-561e-457b-9734-f14c1c69a3b0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.227854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.228692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.229118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.229462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.230681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.232790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.264266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 968/1921] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:02.267194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.281133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01eb22-1759-4abd-8c0d-710f4ee733ca admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.284904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.286353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.287380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.288629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.289736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.290074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.290686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.291011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.291327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.292112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.293007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.293990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.315971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 969/1922] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:02.321436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.332855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe723f-6146-4959-87f1-ee772da49631 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.346450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 954/1923] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/users => generated 279 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:02.350053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.350053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.350053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.350053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.350537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.352098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.352408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.368741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 970/1924] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:02.369921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134d13-32ba-4d6a-83ab-bd243cb97fd7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.370109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.383516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456e44c-5ea1-4232-a8d1-cbdf06b5fae9 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.384190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.384937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.385177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.385453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.386349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.387950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.390983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.392069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.392662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.393157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] PATH_INFO: `/v3/projects/659c176ee68c457698f3fa2c8e066941/users/1b27d90a3bdf411cacf038e7220e8a78/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.414708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 955/1925] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:02.415999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.416171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659c176ee68c457698f3fa2c8e066941, user_id=1b27d90a3bdf411cacf038e7220e8a78, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.420453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658362a-6f92-49fc-9ca9-c32a95f73247 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.437750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edfe27-4fec-409d-836e-d61bd64b8726 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.443310 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.444580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.445580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.445580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.447565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.448577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.467968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 956/1926] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:02.483363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 971/1927] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:02 2022] PUT /identity/v3/projects/659c176ee68c457698f3fa2c8e066941/users/1b27d90a3bdf411cacf038e7220e8a78/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:02.483921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.491689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.492464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.493307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.500438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67ef90-e148-42fe-9952-15a822904871 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.570731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] MFA Rules not processed for user `1b27d90a3bdf411cacf038e7220e8a78`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:02.576467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:02.581474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.583048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.583048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.583048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] PATH_INFO: `/v3/projects/a5f04231e263409487e0859c587d8673/users/35469af0c5744e3ba109f33cf3c88b5e/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.605274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f04231e263409487e0859c587d8673, user_id=35469af0c5744e3ba109f33cf3c88b5e, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.608573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea843798-45da-4ae8-8938-fe435627f65e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.627124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 957/1928] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:02 2022] PUT /identity/v3/projects/a5f04231e263409487e0859c587d8673/users/35469af0c5744e3ba109f33cf3c88b5e/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:02.644195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11edb1-b11d-43b2-96a7-a51d3e18d9cc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.644574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11edb1-b11d-43b2-96a7-a51d3e18d9cc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.644824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11edb1-b11d-43b2-96a7-a51d3e18d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.675836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8d11edb1-b11d-43b2-96a7-a51d3e18d9cc None None] MFA Rules not processed for user `35469af0c5744e3ba109f33cf3c88b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:02.677345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8d11edb1-b11d-43b2-96a7-a51d3e18d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:02.685834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 972/1929] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:02.690546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.703102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb9a1a-dd03-4605-83e6-737586b781c1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.831880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 958/1930] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:02.831880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.831880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.831880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.832340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.832340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.832340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.832340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.832664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.832664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.849226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] MFA Rules not processed for user `0cc5e5dfa3bb45c6bf8c4fcfcaadceec`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:02.851479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:02.868308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 973/1931] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:02.869344 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.921706 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 959/1932] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:02.927969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:02.947304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1607a9-fc80-4f0d-8534-026b4b736d1a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.962914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.963763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.964145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.964550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.965541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.969394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90756ee1-6597-41ad-a8c5-b91225b90003 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:02.969534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.976538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:02.977469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:02.977901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:02.978343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:02.979367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:02.981810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:02.998515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 960/1933] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:03.003904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.019176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 974/1934] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:02 2022] POST /identity/v3/projects => generated 355 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:03.020971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e198d-d62d-4e33-a68b-de45b4bee3d0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.023180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.094709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.095143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3db44-f43a-443f-91f0-dafb0ecb9e46 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.095922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.096393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.096942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.098597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.100976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.101424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.102249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.102381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.102724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.103490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.105687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.116463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 961/1935] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:03.121929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.140704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4fba5-7323-4a27-8a9c-673c20142028 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.145985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 975/1936] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:03 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:03.150825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.152492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.153852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.154190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.154550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] PATH_INFO: `/v3/projects/90ca7fd0ba324d75902a14699c88b283/users/89616a9188ec4dbf95a2687d3fba6875/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.172939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c44b6b-befe-4330-a807-078179c2b8b6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.179680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ca7fd0ba324d75902a14699c88b283, user_id=89616a9188ec4dbf95a2687d3fba6875, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.180547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.181225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.181505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.181776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.182951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.183666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.184928 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.204340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 976/1937] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:03.205461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 962/1938] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:03 2022] PUT /identity/v3/projects/90ca7fd0ba324d75902a14699c88b283/users/89616a9188ec4dbf95a2687d3fba6875/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:03.211579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.212572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.230009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8371-ecbd-4c72-8225-29885d39b598 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.310546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.311615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.312002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.312676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] PATH_INFO: `/v3/projects/7192f560cd444537a7422d7681209044/users/7f2a05a1e60545f5b491eba0cf1751ab/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.314229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180458a-1f2e-4cd1-883e-ef70df6dd668 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.320834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.321523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.321805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.322079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.323353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.324465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.330078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7192f560cd444537a7422d7681209044, user_id=7f2a05a1e60545f5b491eba0cf1751ab, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.332959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.336648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 963/1939] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:03.341059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.351291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 977/1940] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:03 2022] PUT /identity/v3/projects/7192f560cd444537a7422d7681209044/users/7f2a05a1e60545f5b491eba0cf1751ab/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:03.352516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b1340-15f8-4b8c-a1e9-51b9b2de2c6a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.355486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.427876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.429115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.429406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.429683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] PATH_INFO: `/v3/projects/90ca7fd0ba324d75902a14699c88b283/users/89616a9188ec4dbf95a2687d3fba6875/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.432572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ca7fd0ba324d75902a14699c88b283, user_id=89616a9188ec4dbf95a2687d3fba6875, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.435141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa4cb2-b1b8-4456-94e4-508ef808caf9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.436637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936b43-a178-410b-8ca0-4fb7fbd5c8a6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.453820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 964/1941] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:03 2022] PUT /identity/v3/projects/90ca7fd0ba324d75902a14699c88b283/users/89616a9188ec4dbf95a2687d3fba6875/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:03.457240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.458273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.458562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.459651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.460827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.461810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.462071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.462345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.462456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.478774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 978/1942] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:03.479627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.490704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dc891-296e-4bd8-97d6-0e547ebc1ce8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.490966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] MFA Rules not processed for user `89616a9188ec4dbf95a2687d3fba6875`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:03.492182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:03.562083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.562987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.563271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.563548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] PATH_INFO: `/v3/projects/7192f560cd444537a7422d7681209044/users/7f2a05a1e60545f5b491eba0cf1751ab/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.565614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7192f560cd444537a7422d7681209044, user_id=7f2a05a1e60545f5b491eba0cf1751ab, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.568342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c6e7-a4a8-4d00-bb48-c9af68ae2d90 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.585885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 979/1943] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:03 2022] PUT /identity/v3/projects/7192f560cd444537a7422d7681209044/users/7f2a05a1e60545f5b491eba0cf1751ab/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:03.598060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.598358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.598636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.604337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 965/1944] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:03.624548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.626328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:03.630624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] MFA Rules not processed for user `7f2a05a1e60545f5b491eba0cf1751ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:03.632849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:03.713404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067e33f-1309-4a7e-bb07-a33561d0ffc5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.725586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 980/1945] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:03.765420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:03.794532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.795371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.795690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.795891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.836492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c84c8-8cf3-4b2b-bf66-a00314635376 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:03.840541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:03.841199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:03.841480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:03.841752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:03.855211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.856617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.867372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 981/1946] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:03.881119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:03.882719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:03.896218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 966/1947] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:04.014745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:04.029087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ac6e2-193e-4f03-bca1-878a6441ce85 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:04.038933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:04.039602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:04.040486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:04.041163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:04.142851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:04.144409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0310-2ff6-4a26-a35f-a19cf9183f72 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:04.170231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 982/1948] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:04.471542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:04.608893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec4c7f-106f-439c-814d-6af95e2e4846 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:04.614482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:04.617106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:04.617570 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:04.618004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] PATH_INFO: `/v3/users/1b27d90a3bdf411cacf038e7220e8a78` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:04.619510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b27d90a3bdf411cacf038e7220e8a78)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:04.622213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:04.696351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b27d90a3bdf411cacf038e7220e8a78'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:04.709761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b27d90a3bdf411cacf038e7220e8a78'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:04.710694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b27d90a3bdf411cacf038e7220e8a78'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:04.711335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b27d90a3bdf411cacf038e7220e8a78'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:04.718664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b27d90a3bdf411cacf038e7220e8a78'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:04.732018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 967/1949] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:04 2022] DELETE /identity/v3/users/1b27d90a3bdf411cacf038e7220e8a78 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:04.736528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:04.736998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:04.737115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:04.759325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:04.760650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:04.830001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 983/1950] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:04.841081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:04.843331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:04.930689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a6417-babd-4f0c-9723-1f25bc8e44c1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:04.937133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:04.938130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:04.938616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:04.939121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:04.974385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:04.976726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:04.989485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 968/1951] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:06.124474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:06.125922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:06.155035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee504e3-7bcb-4665-bc06-66bd13bdad8b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:06.169847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:06.170795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:06.171115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:06.171373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] PATH_INFO: `/v3/projects/659c176ee68c457698f3fa2c8e066941` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:06.173425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=659c176ee68c457698f3fa2c8e066941)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:06.175701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:06.267967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659c176ee68c457698f3fa2c8e066941', 'request_id': 'req-26ca904f-88ad-4f2a-a808-e2c64964bf2b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.283329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659c176ee68c457698f3fa2c8e066941', 'request_id': 'req-26ca904f-88ad-4f2a-a808-e2c64964bf2b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.320249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659c176ee68c457698f3fa2c8e066941', 'request_id': 'req-26ca904f-88ad-4f2a-a808-e2c64964bf2b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.334962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] The token cache is being invalidate because project 659c176ee68c457698f3fa2c8e066941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:06.335494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.337028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.339308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 984/1952] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:06 2022] DELETE /identity/v3/projects/659c176ee68c457698f3fa2c8e066941 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:06.343624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:06.362635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12609247-7827-4d19-992b-5faf3169db3b service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:06.446429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:06.447781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:06.448355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:06.449763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] PATH_INFO: `/v3/users/89616a9188ec4dbf95a2687d3fba6875` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:06.451512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89616a9188ec4dbf95a2687d3fba6875)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:06.454823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:06.524995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89616a9188ec4dbf95a2687d3fba6875'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.541473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89616a9188ec4dbf95a2687d3fba6875'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.542457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89616a9188ec4dbf95a2687d3fba6875'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.543361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89616a9188ec4dbf95a2687d3fba6875'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.552449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a6ae812a-c037-4949-ad71-cd2b06362759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89616a9188ec4dbf95a2687d3fba6875'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:06.570158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 969/1953] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:06 2022] DELETE /identity/v3/users/89616a9188ec4dbf95a2687d3fba6875 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:07.248061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.249507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:07.265924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca904f-88ad-4f2a-a808-e2c64964bf2b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.341593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.342461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.342746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.343024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] PATH_INFO: `/v3/projects/90ca7fd0ba324d75902a14699c88b283` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.344251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ca7fd0ba324d75902a14699c88b283)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.346426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.399477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ca7fd0ba324d75902a14699c88b283', 'request_id': 'req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.406186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ca7fd0ba324d75902a14699c88b283', 'request_id': 'req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.415144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ca7fd0ba324d75902a14699c88b283', 'request_id': 'req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.430807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] The token cache is being invalidate because project 90ca7fd0ba324d75902a14699c88b283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:07.431093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.431754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efd0a62e-c0d6-4903-a1ea-f8ac22ccb730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.433497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 985/1954] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:07 2022] DELETE /identity/v3/projects/90ca7fd0ba324d75902a14699c88b283 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:07.438490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.438996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.439085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.460163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:07.462681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:07.543792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 970/1955] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:07.545912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.546269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.546578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.567810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:07.569072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:07.577454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 986/1956] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:07.581522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.592786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b635052-55b1-4752-9826-2842b5e94b88 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.597423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.598084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.598379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.598669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.599358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:07.600261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.601890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.613611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 971/1957] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:07.619015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.628637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2114829-eb56-43ba-ae76-5ebd2ae2a85a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.633822 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.634771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.635214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.635554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.639745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.639745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.671871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 987/1958] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:07.673121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.683374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385ae07-b50f-4e8a-a2bc-b155e3f7d9dc admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.723984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.726941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:07.746171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.747695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.747695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.748254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.749519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.751692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.788693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 972/1959] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:07.794080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.813430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213a812-3412-4e5d-9997-2316f646a457 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.818583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.819266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.819566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.819818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.820468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a76e4-0106-4814-90a6-6c4cd0d4b04e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.820768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.823585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.826243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.827126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.827408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.827689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] PATH_INFO: `/v3/users/2d42199962084484bffcefab925cd14d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.828940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d42199962084484bffcefab925cd14d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.830868 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.838627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 973/1960] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:07.839848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.855298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198631-3e27-42dc-b1b5-c408cfb05afa admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.862965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.863822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.864128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.864439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.865225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.866828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.882923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 974/1961] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:07.884255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:07.886495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d42199962084484bffcefab925cd14d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.900244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b659c1-fdfe-4897-b7d3-8d70a6494f41 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:07.900809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d42199962084484bffcefab925cd14d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.901507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d42199962084484bffcefab925cd14d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.902117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d42199962084484bffcefab925cd14d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.906588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:07.908922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.908922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.909151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] PATH_INFO: `/v3/projects/e26efc112f914298ac95d8cb1e5202c2/users/4142bee7d92d4499869d46daebb04c2f/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.911526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-86cf33ec-4c07-454f-9c3f-f953b83782ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d42199962084484bffcefab925cd14d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:07.929158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26efc112f914298ac95d8cb1e5202c2, user_id=4142bee7d92d4499869d46daebb04c2f, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:07.932365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a3e60-864b-4a76-a7c2-2e5be62a8cb1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:07.933115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 988/1962] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:07 2022] DELETE /identity/v3/users/2d42199962084484bffcefab925cd14d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:07.938919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.939210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.939486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:07.962008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:07.971205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 975/1963] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:07 2022] PUT /identity/v3/projects/e26efc112f914298ac95d8cb1e5202c2/users/4142bee7d92d4499869d46daebb04c2f/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:07.971406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:07.976960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:07.977270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:07.978903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.023447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] MFA Rules not processed for user `4142bee7d92d4499869d46daebb04c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:08.025085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:08.076391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 989/1964] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:08.095830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.099275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:08.146022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 976/1965] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:08.147669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.153844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:08.187608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae13f07-a26d-43e3-b0d4-8cafe9eea1b6 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.194558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.195741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3f414-c9d7-4982-b164-6ebbf8dc73d8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.196165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.196586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.197030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.198516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.200454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.201106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.201501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.201780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.202313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.215081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.217140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.232611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 990/1966] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:08.245651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 977/1967] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:08 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:08.250738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.262417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfb0aa-0bb4-47cb-81bf-ef3b1d24fcdc service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.401161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.401860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.402152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.402432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.403253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.405365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.445482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 991/1968] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:08 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:08.449552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.467789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e7a7-bf80-429a-8976-6f67fdf3b123 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.481911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.483236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.483811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.484587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.485712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.488333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.504724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 978/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:08.513592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.526483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab1279-0d76-457b-a26b-dc36bfd2875c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.547170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.549114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.549406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.549688 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] PATH_INFO: `/v3/projects/2de619de9da84008b61f3ef2adb1def9/users/9936215c384f4a739aa19e47fc5cf2d9/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.573114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de619de9da84008b61f3ef2adb1def9, user_id=9936215c384f4a739aa19e47fc5cf2d9, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.576036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.602576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 992/1970] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:08 2022] PUT /identity/v3/projects/2de619de9da84008b61f3ef2adb1def9/users/9936215c384f4a739aa19e47fc5cf2d9/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:08.603857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.624424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb03f-c5db-4a19-98a9-fc4ca95f7348 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.773871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.773871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.773871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.774108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.779050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.783559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe17ed-56d8-4ad3-92ad-cb4cf03ec731 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.803193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 979/1971] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:08.807752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:08.837741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dbd40-3443-42b4-a779-a5ddf4fb0fa5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:08.851764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:08.852720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.853446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.853446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] PATH_INFO: `/v3/projects/2de619de9da84008b61f3ef2adb1def9/users/9936215c384f4a739aa19e47fc5cf2d9/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.855929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de619de9da84008b61f3ef2adb1def9, user_id=9936215c384f4a739aa19e47fc5cf2d9, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:08.858796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:08.902219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 993/1972] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:08 2022] PUT /identity/v3/projects/2de619de9da84008b61f3ef2adb1def9/users/9936215c384f4a739aa19e47fc5cf2d9/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:08.910330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:08.910934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:08.911447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:08.985024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] MFA Rules not processed for user `9936215c384f4a739aa19e47fc5cf2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:08.989236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:09.159009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 980/1973] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:09.172178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:09.174075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:09.274860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc5a44-0de1-4767-9259-33601ae43cf3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:09.280408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:09.281393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:09.281779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:09.282399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:09.295306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:09.297218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:09.310004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 994/1974] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:09.827321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:09.828806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:09.952192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba565-5023-4dfb-94bb-ced72b35aad9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:09.956936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:09.957913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:09.958259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:09.958603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] PATH_INFO: `/v3/projects/f4fe641298e84260a43b19b9f8b514ae` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:09.960068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fe641298e84260a43b19b9f8b514ae)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:09.962466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:10.030328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fe641298e84260a43b19b9f8b514ae', 'request_id': 'req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.041022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fe641298e84260a43b19b9f8b514ae', 'request_id': 'req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.076499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fe641298e84260a43b19b9f8b514ae', 'request_id': 'req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.109861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] The token cache is being invalidate because project f4fe641298e84260a43b19b9f8b514ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:10.110956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.112319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.116608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 981/1975] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:09 2022] DELETE /identity/v3/projects/f4fe641298e84260a43b19b9f8b514ae => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:10.121133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:10.150623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009752d5-efef-44f1-828d-2271157b55d5 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:10.303499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:10.305973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:10.409245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:10.410672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:10.411142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:10.429032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] PATH_INFO: `/v3/users/c477d0cd702340b2b0fb718fa88c44e3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:10.431410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c477d0cd702340b2b0fb718fa88c44e3)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:10.435359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:10.497874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2895305-55a2-4af9-80c1-2b43eb7a1d9d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:10.516513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:10.517812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:10.518304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:10.518681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] PATH_INFO: `/v3/users/4142bee7d92d4499869d46daebb04c2f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:10.537985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4142bee7d92d4499869d46daebb04c2f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:10.547861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:10.570832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c477d0cd702340b2b0fb718fa88c44e3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.592985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c477d0cd702340b2b0fb718fa88c44e3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.593809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c477d0cd702340b2b0fb718fa88c44e3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.594486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c477d0cd702340b2b0fb718fa88c44e3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.614672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5c7a99f0-486e-497a-8a03-70c3dac02556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c477d0cd702340b2b0fb718fa88c44e3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.644533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 995/1976] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:10 2022] DELETE /identity/v3/users/c477d0cd702340b2b0fb718fa88c44e3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:10.657045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4142bee7d92d4499869d46daebb04c2f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.674895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4142bee7d92d4499869d46daebb04c2f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.676449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4142bee7d92d4499869d46daebb04c2f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.677841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4142bee7d92d4499869d46daebb04c2f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.688287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4142bee7d92d4499869d46daebb04c2f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:10.703712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 982/1977] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:10 2022] DELETE /identity/v3/users/4142bee7d92d4499869d46daebb04c2f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:10.708140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:10.708497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:10.708823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:10.731422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:10.733014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:10.817126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 996/1978] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:10.834856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:10.838393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:10.927348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e892a-b476-4a06-b425-a16b5d098ab8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:10.936041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:10.936761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:10.939888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:10.940352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:10.951663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:10.953195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c99ef-e2e4-42a6-ae52-f265ab9d76aa service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:10.965397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 983/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:11.057829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.061451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.075604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52877b3d-0c78-4c5d-aa9f-6f66b148cc91 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.084986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.086103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.086402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.086693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] PATH_INFO: `/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.088397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a685f4826f948ebbc6ecdf9fd16a527)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.090475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.153960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a685f4826f948ebbc6ecdf9fd16a527', 'request_id': 'req-640fea7a-249e-4dc2-9f7e-cea841abb3d5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.164800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a685f4826f948ebbc6ecdf9fd16a527', 'request_id': 'req-640fea7a-249e-4dc2-9f7e-cea841abb3d5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.174093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a685f4826f948ebbc6ecdf9fd16a527', 'request_id': 'req-640fea7a-249e-4dc2-9f7e-cea841abb3d5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.185624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] The token cache is being invalidate because project 1a685f4826f948ebbc6ecdf9fd16a527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:11.185931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.186593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-640fea7a-249e-4dc2-9f7e-cea841abb3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.188504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 997/1980] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:11 2022] DELETE /identity/v3/projects/1a685f4826f948ebbc6ecdf9fd16a527 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:11.195546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.195837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.196115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.215786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:11.217068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.298569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 984/1981] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:11.308076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.308531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.308813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.329597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:11.330800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.339586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 998/1982] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:11.343861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.353963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79405a-b471-4559-a8a0-56da45b22abe None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.358955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.359620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.359907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.360176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.360937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:11.361240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.362882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.378535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 985/1983] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:11.379797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.389759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9c11-88d0-4a94-970d-5d7804ae039f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.395690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.396420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.396839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.397237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.397930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.399822 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.428181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 999/1984] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:11.430517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.440646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375c00-22bd-4053-8980-783e6b49d11f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.510289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.511511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.512583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.512982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.513647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.515588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.520264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.522993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.545307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 986/1985] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:11 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:11.548821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.558333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d889eaf-a27d-45fa-a2d4-f7df73ecf393 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.563094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.564225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.564547 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.564821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] PATH_INFO: `/v3/projects/e26efc112f914298ac95d8cb1e5202c2` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.566468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26efc112f914298ac95d8cb1e5202c2)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.569153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.571109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd0ae4-6e68-485b-ae3a-f8c0b359fb6b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.577743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.578614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.579006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.579386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.580571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.582302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.601835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 987/1986] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:11.615672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.647732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1e48-7e4c-4f98-aa85-3e477f91d0d1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.663970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.664705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.664991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.665270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.666188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.667802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.671610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26efc112f914298ac95d8cb1e5202c2', 'request_id': 'req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.682304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26efc112f914298ac95d8cb1e5202c2', 'request_id': 'req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.682432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 988/1987] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:11.686819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.691953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26efc112f914298ac95d8cb1e5202c2', 'request_id': 'req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.699904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b048ddd-ef24-4121-af52-24219099fa1d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.707134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] The token cache is being invalidate because project e26efc112f914298ac95d8cb1e5202c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:11.707428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.708117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.710288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1000/1988] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:11 2022] DELETE /identity/v3/projects/e26efc112f914298ac95d8cb1e5202c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:11.714448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:11.715603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.779679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.780887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.781199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.781552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] PATH_INFO: `/v3/projects/8ad4a689878a46dba0c9c49f92982e50/users/22491f5103cf46daabefa4125835306e/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.807428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8f68-1bcd-42b2-b88f-9a92bd490c9b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:11.807621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad4a689878a46dba0c9c49f92982e50, user_id=22491f5103cf46daabefa4125835306e, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.810466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844d7c3-318f-4843-8596-034f9f0c2ed2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.813778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:11.814681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.814965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.815244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] PATH_INFO: `/v3/users/9936215c384f4a739aa19e47fc5cf2d9` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.817153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9936215c384f4a739aa19e47fc5cf2d9)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:11.820116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:11.830080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 989/1989] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:11 2022] PUT /identity/v3/projects/8ad4a689878a46dba0c9c49f92982e50/users/22491f5103cf46daabefa4125835306e/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:11.841905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:11.842445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:11.842445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:11.883043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] MFA Rules not processed for user `22491f5103cf46daabefa4125835306e`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:11.884920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:11.931496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9936215c384f4a739aa19e47fc5cf2d9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.979897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9936215c384f4a739aa19e47fc5cf2d9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.982057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9936215c384f4a739aa19e47fc5cf2d9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.983416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9936215c384f4a739aa19e47fc5cf2d9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:11.999959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9936215c384f4a739aa19e47fc5cf2d9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.023700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 990/1990] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:12.034946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1001/1991] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:11 2022] DELETE /identity/v3/users/9936215c384f4a739aa19e47fc5cf2d9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:12.082728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:12.093809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.257827 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f281987-e94f-4a58-859e-b0ec384f048f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:12.380124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:12.382082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.382872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.383542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.487060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:12.488947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:12.501655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 991/1992] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:12.544980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:12.546460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.605088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:12.606600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.670112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b75ecd-7225-4919-9380-2622da9dc927 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:12.676222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:12.677482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.677982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.678459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] PATH_INFO: `/v3/users/22491f5103cf46daabefa4125835306e` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.680160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22491f5103cf46daabefa4125835306e)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:12.684545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:12.697488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddfa56-82fd-40f9-9327-475f393f3a35 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:12.704499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:12.706120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.706120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.706815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] PATH_INFO: `/v3/projects/2de619de9da84008b61f3ef2adb1def9` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.708305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de619de9da84008b61f3ef2adb1def9)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:12.711330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:12.770661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22491f5103cf46daabefa4125835306e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.772632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de619de9da84008b61f3ef2adb1def9', 'request_id': 'req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.781454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de619de9da84008b61f3ef2adb1def9', 'request_id': 'req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.791365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22491f5103cf46daabefa4125835306e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.791626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de619de9da84008b61f3ef2adb1def9', 'request_id': 'req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.792089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22491f5103cf46daabefa4125835306e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.792958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22491f5103cf46daabefa4125835306e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.801893 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-26e3d7e6-de49-4e00-a1d9-d991a5c04bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22491f5103cf46daabefa4125835306e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.807690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] The token cache is being invalidate because project 2de619de9da84008b61f3ef2adb1def9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:12.808061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.808925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bd2d865b-1c80-41eb-9138-368f1ad7dd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:12.812416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 992/1993] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:12 2022] DELETE /identity/v3/projects/2de619de9da84008b61f3ef2adb1def9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:12.815963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814564fa-7dc2-445d-96d0-1e7ebcf635b8 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.816479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814564fa-7dc2-445d-96d0-1e7ebcf635b8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.817130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814564fa-7dc2-445d-96d0-1e7ebcf635b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.821704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1002/1994] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:12 2022] DELETE /identity/v3/users/22491f5103cf46daabefa4125835306e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:12.827013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.827013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.827013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.840190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-814564fa-7dc2-445d-96d0-1e7ebcf635b8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:12.841961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-814564fa-7dc2-445d-96d0-1e7ebcf635b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.848707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:12.850338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.921397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1003/1995] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:12.928945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 993/1996] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:12.933561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:12.935205 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.936965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.937491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.937780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.957196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:12.958437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:12.970257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 994/1997] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:12.971036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:12.980075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726072f6-4378-4d46-a17c-a731264dc776 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:12.986567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:12.987243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:12.987525 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:12.987799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:12.988564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:12.988869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:12.991040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:12.999579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aed63-03d0-4c94-953f-3927b9ed3f75 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.004540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.005208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.005494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.006120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.007159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 995/1998] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:13.007985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.016458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.018025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a1af9-c436-412b-8239-6323692699c1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.018546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.023754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.024263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.024582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.024861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.025556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.027458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.031285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1004/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:13.068489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 996/2000] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:13.070435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.080109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835340e-7807-486c-93cc-745a9052f3f5 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.141219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.141931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.142303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.142584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.143289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.145827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.167844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1005/2001] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:13.172051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.183857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061023d-a9e1-41d8-aca7-2d88425b6e22 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.188810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.189478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.189767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.190046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.190782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.192423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.204743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 997/2002] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:13.209615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.220637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad90f54-31d7-4f61-a976-bcdbd4a75fd3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.228000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.228787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.229147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.229500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.230315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.232404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec614e-8ed6-4816-b05a-e6f62066f541 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.248328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1006/2003] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:13.249900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.260458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839313c-37ee-4c5c-b597-23b57c4c9687 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.265387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.266273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.266562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.266843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] PATH_INFO: `/v3/projects/2d622ff142f241bc975d80a6ddf001de/users/fedea12585c8458dada9de281bc3fbe8/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.288817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d622ff142f241bc975d80a6ddf001de, user_id=fedea12585c8458dada9de281bc3fbe8, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.291001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.308321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 998/2004] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:13 2022] PUT /identity/v3/projects/2d622ff142f241bc975d80a6ddf001de/users/fedea12585c8458dada9de281bc3fbe8/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:13.315767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.316520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.316520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.348290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] MFA Rules not processed for user `fedea12585c8458dada9de281bc3fbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:13.350832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:13.356978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.358900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:13.444520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1007/2005] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:13.459216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.461727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:13.476741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998b6f-014d-46b6-a49b-0bcba21ca9a8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.484907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.486207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.486639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.487032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] PATH_INFO: `/v3/projects/8ad4a689878a46dba0c9c49f92982e50` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.488632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad4a689878a46dba0c9c49f92982e50)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.492899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.545660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75af9a-9397-4f80-ad72-38e0b4a1c86f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.562082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad4a689878a46dba0c9c49f92982e50', 'request_id': 'req-a9e4101c-2738-4074-b8a4-02af21afb1c8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:13.579809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad4a689878a46dba0c9c49f92982e50', 'request_id': 'req-a9e4101c-2738-4074-b8a4-02af21afb1c8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:13.607740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad4a689878a46dba0c9c49f92982e50', 'request_id': 'req-a9e4101c-2738-4074-b8a4-02af21afb1c8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:13.622470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.623140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.623428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.623698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.629694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] The token cache is being invalidate because project 8ad4a689878a46dba0c9c49f92982e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:13.630047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:13.630715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a9e4101c-2738-4074-b8a4-02af21afb1c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:13.632604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 999/2006] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:13 2022] DELETE /identity/v3/projects/8ad4a689878a46dba0c9c49f92982e50 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:13.638901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.639220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.640167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.683890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:13.686031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:13.758154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.760743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5261-e82d-4129-a04a-f74dfb5bc719 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.774546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1008/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:13.802713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1000/2008] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:13.811031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.811326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.812857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.833453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:13.836216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:13.870553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1009/2009] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:13.871981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.889233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3b26-df25-49cb-af45-b20927c3be6c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.901820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.902970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.903477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.903961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.905002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:13.905495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.907734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:13.929604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:13.932229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1001/2010] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:13.947652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc2ef0-d592-4fec-bc72-42e5ed2eca81 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:13.961702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:13.962383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:13.962663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:13.962932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:13.963636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:13.965778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.040815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1010/2011] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:13 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:14.045590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.063802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac27d-15e0-4b2e-a463-d2b9c853ec56 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.169733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.170447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.170723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.171002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.173165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.175121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.225113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1002/2012] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:14 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:14.229707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.252475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e3c8f-9e91-4f58-b451-2cb4bd76a23e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.266919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.268295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.268567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.270030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.272707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.284444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.285546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.289711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.297230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f2127-ea8e-45c6-9475-f5fba39e6da2 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.331180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.332078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.332380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.332656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] PATH_INFO: `/v3/users/f4fabe073e2f4fa1bfb6c5fbaf859eac` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.335321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fabe073e2f4fa1bfb6c5fbaf859eac)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.337344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.339026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1011/2013] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:14.340015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.361518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277e18e-8aee-45b8-ae46-6a09381b4af2 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.375081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.375828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.376188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.376864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.381947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.383796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.416345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1012/2014] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:14.418055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fabe073e2f4fa1bfb6c5fbaf859eac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.420338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.433124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07dc8-a2da-4ef7-8326-2a645cf70f03 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.438830 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.439393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fabe073e2f4fa1bfb6c5fbaf859eac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.439738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.440425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fabe073e2f4fa1bfb6c5fbaf859eac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.440543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.440679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] PATH_INFO: `/v3/projects/4cfc2ec13a4f4ae8ae7c87c72078116f/users/3e29155ed961453b95960dc92974d9de/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.440809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fabe073e2f4fa1bfb6c5fbaf859eac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.450562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-08596541-7521-4376-bc64-f6d9a3808a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fabe073e2f4fa1bfb6c5fbaf859eac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.458079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfc2ec13a4f4ae8ae7c87c72078116f, user_id=3e29155ed961453b95960dc92974d9de, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.462043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.467248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1003/2015] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:14 2022] DELETE /identity/v3/users/f4fabe073e2f4fa1bfb6c5fbaf859eac => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:14.477936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1013/2016] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:14 2022] PUT /identity/v3/projects/4cfc2ec13a4f4ae8ae7c87c72078116f/users/3e29155ed961453b95960dc92974d9de/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:14.489167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.489458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.491560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.519847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] MFA Rules not processed for user `3e29155ed961453b95960dc92974d9de`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:14.521092 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.595971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1004/2017] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:14.607828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.610561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.684875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.686044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b310-8a39-4ba5-b23f-4e4ffae3725f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.686504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.689849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.690486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.690772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.691049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.703509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.705220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.715249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1014/2018] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:14.738591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:14.740723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.771503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2487-d73f-4833-8cd2-054b62285196 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.782167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.783098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.783376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.783680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] PATH_INFO: `/v3/projects/60f85e7bbb38404ba6b68eff605a3306` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.785148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f85e7bbb38404ba6b68eff605a3306)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.787526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.814194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166dfa-2ae0-478d-ac02-8567eabbea43 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:14.818876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:14.819763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.820046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.824110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] PATH_INFO: `/v3/users/3e29155ed961453b95960dc92974d9de` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.827209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e29155ed961453b95960dc92974d9de)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:14.829321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:14.854212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f85e7bbb38404ba6b68eff605a3306', 'request_id': 'req-ae52bc3c-3279-4277-989f-fd9edbe9705c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.868060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f85e7bbb38404ba6b68eff605a3306', 'request_id': 'req-ae52bc3c-3279-4277-989f-fd9edbe9705c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.878364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f85e7bbb38404ba6b68eff605a3306', 'request_id': 'req-ae52bc3c-3279-4277-989f-fd9edbe9705c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.886540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e29155ed961453b95960dc92974d9de'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.891730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] The token cache is being invalidate because project 60f85e7bbb38404ba6b68eff605a3306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:14.892593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.893664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ae52bc3c-3279-4277-989f-fd9edbe9705c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.899386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1005/2019] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:14 2022] DELETE /identity/v3/projects/60f85e7bbb38404ba6b68eff605a3306 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:14.901837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e29155ed961453b95960dc92974d9de'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.902175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e2b5-5fb4-4f95-b3f0-c6f8db1e3d25 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.902619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e2b5-5fb4-4f95-b3f0-c6f8db1e3d25 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.902730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e29155ed961453b95960dc92974d9de'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.903120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483e2b5-5fb4-4f95-b3f0-c6f8db1e3d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.903275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e29155ed961453b95960dc92974d9de'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.910279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff4aa0f4-85a0-42e9-a0ff-ff71ab87b49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e29155ed961453b95960dc92974d9de'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:14.922744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9483e2b5-5fb4-4f95-b3f0-c6f8db1e3d25 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:14.923936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9483e2b5-5fb4-4f95-b3f0-c6f8db1e3d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.925631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1015/2020] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:14 2022] DELETE /identity/v3/users/3e29155ed961453b95960dc92974d9de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:14.931487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.931825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.932204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:14.951460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:14.952650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:14.984172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1006/2021] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:14.995600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:14.995912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:14.996190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.014491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:15.015710 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:15.016226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1016/2022] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:15.024885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1007/2023] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:15.026850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.028332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:15.028704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.040555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da320d30-0ec6-40d8-9eb6-5fdb01792aea None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.046681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.047377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.047685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.047960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.048801 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:15.049104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.050762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.063306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1008/2024] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:49:15.067644 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.077976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c16b2-fd27-4db2-aec5-177b5a70d257 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.082715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.083371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.083651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.084440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.085146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.087048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.088774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3255ad-b8a0-4d4c-a033-459ae2c1949a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.092477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.093125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.093408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.093685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.104113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.105742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.115910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1009/2025] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:15.119093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1017/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:15.120025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.205876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3c3ac-4776-4dad-a866-74c7384acbb9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.212227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.212937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.213296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.213603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.214438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.216484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.240631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1010/2027] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:15.244796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.255650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b5c0-ccfd-4ee0-b52c-e0af4df227da service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.260606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.261184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.261465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.261739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.262471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.264066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.276461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1018/2028] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:15.280142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.292104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e508a-e654-4a01-9abe-e836a3808a22 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.297306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.298394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.298394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.298728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.299529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.301509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c748e-93d7-4574-a6b3-0b74e81cafea admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.318244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1011/2029] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:15.322611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.333273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be76365-d566-446e-917e-637f0364f1ab admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.339005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.339896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.340184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.340487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] PATH_INFO: `/v3/projects/c86e3556b80c4de48963d5509f31110f/users/2492b53148014e039e6b045d8215f5e1/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.367022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86e3556b80c4de48963d5509f31110f, user_id=2492b53148014e039e6b045d8215f5e1, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.370686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.391838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1019/2030] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:15 2022] PUT /identity/v3/projects/c86e3556b80c4de48963d5509f31110f/users/2492b53148014e039e6b045d8215f5e1/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:15.403905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.404421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.404877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.454887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] MFA Rules not processed for user `2492b53148014e039e6b045d8215f5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:15.456699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:15.606690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1012/2031] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:15.611904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.694006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.697155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:15.755177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e419de2-000b-40cb-b8be-230c0cd5632b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.761423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.762111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.762395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.762691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.763783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.765386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.800760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6697ff0-29df-4f36-a9c9-e6deebce5e4c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.805906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.806785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.807073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.807346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] PATH_INFO: `/v3/projects/4cfc2ec13a4f4ae8ae7c87c72078116f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.808576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfc2ec13a4f4ae8ae7c87c72078116f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.810598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:15.812240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1020/2032] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:15.813311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:15.872951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfc2ec13a4f4ae8ae7c87c72078116f', 'request_id': 'req-8018c575-d9f9-4f6d-a789-90628aded8fe'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:15.885268 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfc2ec13a4f4ae8ae7c87c72078116f', 'request_id': 'req-8018c575-d9f9-4f6d-a789-90628aded8fe'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:15.896020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834b06-8820-4c56-afd3-8b22e92ca674 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:15.902433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfc2ec13a4f4ae8ae7c87c72078116f', 'request_id': 'req-8018c575-d9f9-4f6d-a789-90628aded8fe'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:15.917728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] The token cache is being invalidate because project 4cfc2ec13a4f4ae8ae7c87c72078116f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:15.918109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:15.918832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8018c575-d9f9-4f6d-a789-90628aded8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:15.920844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1013/2033] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:15 2022] DELETE /identity/v3/projects/4cfc2ec13a4f4ae8ae7c87c72078116f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:15.925576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262f23-646f-4fb0-9193-8b02156db06d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.926218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262f23-646f-4fb0-9193-8b02156db06d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.926597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8262f23-646f-4fb0-9193-8b02156db06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.954638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e8262f23-646f-4fb0-9193-8b02156db06d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:15.956464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e8262f23-646f-4fb0-9193-8b02156db06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:15.991707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:15.992470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:15.992758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:15.993044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:15.994482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:15.996586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.027178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1021/2034] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:16.028631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.030784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.049177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302faba-0a49-4e3c-b623-0c2b3b2ade23 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.056446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.057346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.057710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.058005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.059006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.059148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1014/2035] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:16.060459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.068974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.069267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.069550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.074000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1022/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:16.078385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.089559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389fb8a-040d-44c1-94ea-787b0acf1514 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.095384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.095896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:16.096643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.097067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.097182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.097677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] PATH_INFO: `/v3/projects/33fa93c7242f4682ad90ec195ee36763/users/6def1ad1bcd546b297c986af8e7550e5/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.118445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa93c7242f4682ad90ec195ee36763, user_id=6def1ad1bcd546b297c986af8e7550e5, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.118775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1015/2037] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:16.121376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.123387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.141966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1023/2038] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:16 2022] PUT /identity/v3/projects/33fa93c7242f4682ad90ec195ee36763/users/6def1ad1bcd546b297c986af8e7550e5/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:16.142668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc738ba-1a66-4ee8-a0fe-2af270cf0d63 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.148860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.246072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dfd2a-da14-4cd4-ae83-362185f174ed admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.253177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.254856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.255493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.256140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.256500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.257061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.257354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.257633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.258382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:16.258517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.258841 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.260786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.268978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.284617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1016/2039] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:49:16.285884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.297728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1024/2040] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:16.298905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.305382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6f48-29eb-424e-a087-6bee79959b85 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.310672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.311475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.311765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.312044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.312779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.314800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.317069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57c5d4-deab-42c5-bd3f-ddc50e2fb21a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.327505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.328635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.329575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.330017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] PATH_INFO: `/v3/projects/33fa93c7242f4682ad90ec195ee36763/users/6def1ad1bcd546b297c986af8e7550e5/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.333414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fa93c7242f4682ad90ec195ee36763, user_id=6def1ad1bcd546b297c986af8e7550e5, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.336887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be90b4-ea39-42f3-89ad-f6512afdd549 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.347374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1017/2041] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:16.348881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.350230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1025/2042] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:16 2022] PUT /identity/v3/projects/33fa93c7242f4682ad90ec195ee36763/users/6def1ad1bcd546b297c986af8e7550e5/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:16.362655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.362929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.363264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.403050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] MFA Rules not processed for user `6def1ad1bcd546b297c986af8e7550e5`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:16.404760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.430714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb159-a85e-46c4-b54a-1371abb60c31 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.435635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.436401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.436695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.436979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.437674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.439617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.464294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1018/2043] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:16.465431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.476157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcd15c-d3f0-4675-96d8-d3b8ccc5b53d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.481220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.482198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.482550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.483171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.483982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.485799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.486930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1026/2044] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:16.499294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.499802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1019/2045] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:16.501274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.503829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.513981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020781c7-4020-4249-aad1-3e9e0982785d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.518957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.519624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.519903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.520177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.521020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.523410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.534463 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1020/2046] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:16.539214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.550421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b3c88-934e-4189-89b1-0fe8dc353cad admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.556766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.558859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.558859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.558859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] PATH_INFO: `/v3/projects/24f4fe1fc63045b1a13819c47db3a6e7/users/4a26e01b14774eaeb88ff92ddebd90f0/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.561739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdae94f-58d4-4529-98cc-95aede1db3ff None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.564940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.565660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.565969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.566250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.576875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.578084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f4fe1fc63045b1a13819c47db3a6e7, user_id=4a26e01b14774eaeb88ff92ddebd90f0, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.578278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7a38-ee6a-4d76-b453-a1f2c589ac3f service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.580811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.590559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1027/2047] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:16.595583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1021/2048] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:16 2022] PUT /identity/v3/projects/24f4fe1fc63045b1a13819c47db3a6e7/users/4a26e01b14774eaeb88ff92ddebd90f0/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:16.607255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.607552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.607843 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.641295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] MFA Rules not processed for user `4a26e01b14774eaeb88ff92ddebd90f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:16.642670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.669125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.718460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1028/2049] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:16.722947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.749583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d1131-c420-48d5-b279-2c4a9762566a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.763660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.764388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.764679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.764957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.767252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:16.828099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c072-255c-4333-af3c-a046a17d3852 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.840979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.841982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.842475 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.842960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.844061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.846791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.879329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.879329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.879663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1029/2050] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:16.879831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:16.885748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1022/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:16.954516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e93-d161-4cf2-b186-8c948b0c6ee3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:16.960811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:16.961486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:16.961770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:16.962049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:16.962758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:16.964732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:16.985232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1030/2052] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:16 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:16.989921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.001630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367144b-c645-4bd9-85eb-ca19b919181e service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.008769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.009906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.009906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.010055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.010712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.012349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.029229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1023/2053] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:17.030820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.043133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce79634-90c1-4042-96f5-446d32aad156 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.048231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.048977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.049271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.049581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.050324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.052196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0bd40-651c-4dfb-9938-14dd1e7fe3db admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.063186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1031/2054] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:17.067526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.078246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa10e4-7fab-4dad-92da-8a9d7b21d9d9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.082883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.084933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.085229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.085519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] PATH_INFO: `/v3/projects/52bab4bf28ea41f189bda309935f78dd/users/96b0a05cd2a74fc58e03f7efc1c40583/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.102289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bab4bf28ea41f189bda309935f78dd, user_id=96b0a05cd2a74fc58e03f7efc1c40583, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.105400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.118646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1024/2055] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:17 2022] PUT /identity/v3/projects/52bab4bf28ea41f189bda309935f78dd/users/96b0a05cd2a74fc58e03f7efc1c40583/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:17.129940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.130337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.131244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.158601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] MFA Rules not processed for user `96b0a05cd2a74fc58e03f7efc1c40583`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:17.159789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.232081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1032/2056] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:17.237188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.296434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.297856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.304520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14e819-7f1e-4e5c-acd8-aa0e1967bccc admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.309295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.309982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.310264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.310542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.311273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.311986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2528-7f7f-4ce2-bad1-c960dff472aa None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.313285 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.316529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.317378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.317658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.317933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] PATH_INFO: `/v3/users/fedea12585c8458dada9de281bc3fbe8` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.319651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fedea12585c8458dada9de281bc3fbe8)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.321586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.341038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1025/2057] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:17 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:17.345398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.374529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fedea12585c8458dada9de281bc3fbe8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:17.387796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fedea12585c8458dada9de281bc3fbe8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:17.389285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fedea12585c8458dada9de281bc3fbe8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:17.389285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fedea12585c8458dada9de281bc3fbe8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:17.396043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-38f47014-3ce4-4d53-a179-bb157ffffedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fedea12585c8458dada9de281bc3fbe8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:17.413484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1033/2058] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:17 2022] DELETE /identity/v3/users/fedea12585c8458dada9de281bc3fbe8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:17.415805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.416182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.416579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.419472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ffcfa-c6f8-430a-ba4c-655f49ef0502 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.437351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:17.438531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.478038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.478728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.479177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.479461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.480155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.482124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.512191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1034/2059] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:17.512483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1026/2060] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:17 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:17.512585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.512585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.513067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.514780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.523752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c7b1-2285-47dd-9420-a9958daee349 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.528639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.530064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.530348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.530626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.537554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.539628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.550335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1035/2061] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:17.554588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.564824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b327f-1aeb-481d-bf5c-377475bc2919 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.569705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.570602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.570887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.571186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] PATH_INFO: `/v3/projects/2816bdf629b74d76abf569ae79c2b327/users/40f4343ce26040c5b90307523e2fa119/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.576936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a157671-1260-4b3b-9fcc-f9d8a9aa3755 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.580583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.581241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.581517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.581793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.587628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2816bdf629b74d76abf569ae79c2b327, user_id=40f4343ce26040c5b90307523e2fa119, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.590663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.592346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.593783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.605439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1027/2062] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:17.607410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1036/2063] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:17 2022] PUT /identity/v3/projects/2816bdf629b74d76abf569ae79c2b327/users/40f4343ce26040c5b90307523e2fa119/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:17.612948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.623053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c42f5-ce6e-4bf2-a81f-9233328da87a service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.699878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.700604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.700886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.707094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.707930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.709558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355ad4e-199c-49a6-99f1-6b02c371d040 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.724712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1028/2064] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:17.725978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.740967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887799eb-2d07-466f-a178-af9d979c4615 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:17.757148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:17.757148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.757148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.757148 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] PATH_INFO: `/v3/projects/2816bdf629b74d76abf569ae79c2b327/users/40f4343ce26040c5b90307523e2fa119/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.757654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2816bdf629b74d76abf569ae79c2b327, user_id=40f4343ce26040c5b90307523e2fa119, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:17.757654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:17.783864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1037/2065] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:17 2022] PUT /identity/v3/projects/2816bdf629b74d76abf569ae79c2b327/users/40f4343ce26040c5b90307523e2fa119/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:17.796409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:17.796700 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:17.796982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:17.830115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] MFA Rules not processed for user `40f4343ce26040c5b90307523e2fa119`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:17.831992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.916444 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1029/2066] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:17.940732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.943984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:17.949309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:17.953247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:18.069119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4e485-8453-48ae-b6e9-cf1c48c8618d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.078426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.080057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.080641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.081118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.084955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:18.098788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44822ec-4008-4426-bc0d-3950c1d65e6e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.126746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.127627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.129877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.130313 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] PATH_INFO: `/v3/projects/2d622ff142f241bc975d80a6ddf001de` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.136078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d622ff142f241bc975d80a6ddf001de)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.138141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.226861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d622ff142f241bc975d80a6ddf001de', 'request_id': 'req-f0f6581b-b821-4b80-8837-c8ebf3772a5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:18.227753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.229616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc59d-0378-4501-8b94-5fef777f6f38 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.236622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d622ff142f241bc975d80a6ddf001de', 'request_id': 'req-f0f6581b-b821-4b80-8837-c8ebf3772a5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:18.242038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1030/2067] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:18.261511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d622ff142f241bc975d80a6ddf001de', 'request_id': 'req-f0f6581b-b821-4b80-8837-c8ebf3772a5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:18.274511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] The token cache is being invalidate because project 2d622ff142f241bc975d80a6ddf001de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:18.274890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:18.275627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f0f6581b-b821-4b80-8837-c8ebf3772a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:18.277614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1038/2068] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:17 2022] DELETE /identity/v3/projects/2d622ff142f241bc975d80a6ddf001de => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:18.283496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.283782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.284064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.304548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:18.306344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:18.387556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1031/2069] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:18.397469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.397656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.397924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.429656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:18.431350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:18.440604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1039/2070] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:18.446182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.456868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b33ca-d0cb-41c1-b443-af5cb67f00fd None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.463030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.463723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.464060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.464395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.465218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:18.465597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.467341 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.482874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1032/2071] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:18.487932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.498317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f13f8-2c27-4e08-ba90-0ae47fcbfa19 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.503272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.504311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.504311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.504538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.505227 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.507614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.546499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1040/2072] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:18 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:18.550754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.561847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045542b-f430-48c9-b738-0d8ea9e2cb9b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.668014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.669095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.669377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.669655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.671315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.674146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.712054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1033/2073] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:18 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:18.714776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.730915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37225-e477-400a-b66d-92fad6baade4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.741464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.742482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.742595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.742818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.743711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.745583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.757943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1041/2074] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:18.762495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.774364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487f67-b3e3-49e6-b098-5d6dab3b9511 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.781546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.782372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.782655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.782928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.783687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.785302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc679-15cd-4689-ad42-a2fe04fa2cd5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.796851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1034/2075] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:18.800780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.811933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f8ec2-c6a1-4903-8280-93b35c8d1836 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:18.817246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:18.818666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.818953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.819225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] PATH_INFO: `/v3/projects/c8054f104e3b4786b875d9ba5852c014/users/e770bdbdd26a4e5499cc3695fcd1f42a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.833751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8054f104e3b4786b875d9ba5852c014, user_id=e770bdbdd26a4e5499cc3695fcd1f42a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:18.836522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:18.849825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1042/2076] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:18 2022] PUT /identity/v3/projects/c8054f104e3b4786b875d9ba5852c014/users/e770bdbdd26a4e5499cc3695fcd1f42a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:18.860230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:18.860559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:18.860840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:18.889374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] MFA Rules not processed for user `e770bdbdd26a4e5499cc3695fcd1f42a`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:18.890666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:18.955875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1035/2077] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:18.967254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:18.968991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:19.026519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174c0e1-59b2-4377-8c63-33a3084d3c24 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:19.030393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:19.031043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:19.031327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:19.031608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:19.041122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:19.042559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:19.051447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1043/2078] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:20.109000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:20.110659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:20.124542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffff127-e75e-4501-a91d-7a7bfdc7cae2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:20.129082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:20.129739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:20.130013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:20.130286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:20.134689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:20.205229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:20.206014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a3b81-d919-45b9-8586-841257fcde8a service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:20.216013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1036/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:21.438753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:21.448470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee9b36-6d18-46d8-82c7-632f9afad818 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:21.452079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:21.452765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:21.453046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:21.453321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:21.455130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:21.518122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:21.519579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:21.529983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1044/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:23.976423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfd33-7465-4d11-9017-f2244c2cafda None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:23.977230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfd33-7465-4d11-9017-f2244c2cafda None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:23.977849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cfd33-7465-4d11-9017-f2244c2cafda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:24.001329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-347cfd33-7465-4d11-9017-f2244c2cafda None None] MFA Rules not processed for user `0cc5e5dfa3bb45c6bf8c4fcfcaadceec`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:24.002564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-347cfd33-7465-4d11-9017-f2244c2cafda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:24.063247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1037/2081] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:24.810800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:24.812184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:24.889120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f977d0-2e60-4a7e-a7f9-e1038efa17e6 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:24.893690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:24.894574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:24.895230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:24.895516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] PATH_INFO: `/v3/users/35469af0c5744e3ba109f33cf3c88b5e` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:24.897401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35469af0c5744e3ba109f33cf3c88b5e)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:24.899413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:24.953673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35469af0c5744e3ba109f33cf3c88b5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:24.971041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35469af0c5744e3ba109f33cf3c88b5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:24.972020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35469af0c5744e3ba109f33cf3c88b5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:24.972692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35469af0c5744e3ba109f33cf3c88b5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:24.981674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35469af0c5744e3ba109f33cf3c88b5e'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:24.998035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1045/2082] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:24 2022] DELETE /identity/v3/users/35469af0c5744e3ba109f33cf3c88b5e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:25.002655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:25.003156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:25.003272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:25.022933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:25.023488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:25.119415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1038/2083] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:25.133164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:25.137720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:25.213172 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844bd8-4ebc-4d60-b009-f16f4104fc13 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:25.217431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:25.218090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:25.218380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:25.218701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:25.233469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:25.234914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:25.248508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1046/2084] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:25.692447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:25.694515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:25.708286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce148d-fd99-4a0a-a078-1502332b0a2d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:25.714806 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:25.715807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:25.715994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:25.716240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] PATH_INFO: `/v3/projects/a5f04231e263409487e0859c587d8673` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:25.717583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f04231e263409487e0859c587d8673)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:25.719527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:25.767354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f04231e263409487e0859c587d8673', 'request_id': 'req-5b83cd20-7489-46f8-a891-042a316ae724'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.775560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f04231e263409487e0859c587d8673', 'request_id': 'req-5b83cd20-7489-46f8-a891-042a316ae724'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.784112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f04231e263409487e0859c587d8673', 'request_id': 'req-5b83cd20-7489-46f8-a891-042a316ae724'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.796456 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] The token cache is being invalidate because project a5f04231e263409487e0859c587d8673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:25.796746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.797399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.799352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1039/2085] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:25 2022] DELETE /identity/v3/projects/a5f04231e263409487e0859c587d8673 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:25.804371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:25.816446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f6c4b-44af-45d3-ac4c-93f83306376f service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:25.901849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:25.902845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:25.903247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:25.903873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] PATH_INFO: `/v3/users/7f2a05a1e60545f5b491eba0cf1751ab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:25.905519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2a05a1e60545f5b491eba0cf1751ab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:25.907848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:25.963370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2a05a1e60545f5b491eba0cf1751ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.979825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2a05a1e60545f5b491eba0cf1751ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.980508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2a05a1e60545f5b491eba0cf1751ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.981157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2a05a1e60545f5b491eba0cf1751ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:25.988466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2a05a1e60545f5b491eba0cf1751ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.003134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1047/2086] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:25 2022] DELETE /identity/v3/users/7f2a05a1e60545f5b491eba0cf1751ab => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:26.333603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.336948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.355778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83cd20-7489-46f8-a891-042a316ae724 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.374269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.376190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.436543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.437656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.438051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.438481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] PATH_INFO: `/v3/projects/7192f560cd444537a7422d7681209044` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.439750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7192f560cd444537a7422d7681209044)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.441735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.456636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28ed3-a2c5-472a-8593-9ee784a341e8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.462169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.463091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.463387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.463659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] PATH_INFO: `/v3/users/2492b53148014e039e6b045d8215f5e1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.464913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2492b53148014e039e6b045d8215f5e1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.466869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.498535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7192f560cd444537a7422d7681209044', 'request_id': 'req-eec13523-cf5c-4333-9922-76de67f432de'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.508153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7192f560cd444537a7422d7681209044', 'request_id': 'req-eec13523-cf5c-4333-9922-76de67f432de'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.517093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7192f560cd444537a7422d7681209044', 'request_id': 'req-eec13523-cf5c-4333-9922-76de67f432de'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.541119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] The token cache is being invalidate because project 7192f560cd444537a7422d7681209044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:26.541842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.548997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-eec13523-cf5c-4333-9922-76de67f432de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.549509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2492b53148014e039e6b045d8215f5e1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.564791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1040/2087] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:26 2022] DELETE /identity/v3/projects/7192f560cd444537a7422d7681209044 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:26.579758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eeb88-9a36-44c7-9e00-6fea58063de2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.580058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eeb88-9a36-44c7-9e00-6fea58063de2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.580373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eeb88-9a36-44c7-9e00-6fea58063de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.580572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2492b53148014e039e6b045d8215f5e1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.581479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2492b53148014e039e6b045d8215f5e1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.582097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2492b53148014e039e6b045d8215f5e1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.591415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-1af1012a-50ec-4c46-9fff-c0804c316172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2492b53148014e039e6b045d8215f5e1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.603655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b87eeb88-9a36-44c7-9e00-6fea58063de2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:26.605361 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b87eeb88-9a36-44c7-9e00-6fea58063de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.610720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1048/2088] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:26 2022] DELETE /identity/v3/users/2492b53148014e039e6b045d8215f5e1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:26.617409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.618019 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.618515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.641658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:26.643370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.688387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1041/2089] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:26.702216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.702751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.703316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.726089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:26.731426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.732621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1049/2090] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:26.746078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1042/2091] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:26.746226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.750039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.750195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.763555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c57bdf-4333-4d1c-8c09-e6a95c81dae8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.767864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.768981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.769433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.769719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.770454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:26.770983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.773495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.799848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1043/2092] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:49:26.805231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.811907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:26.838578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bdfb0-e3f7-44d8-9200-195b26e2c484 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.839904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bed29-4085-4184-8602-3dafb02dcee3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.843994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.844211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.844896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.845181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.845296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.845458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.845756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.846382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] PATH_INFO: `/v3/users/4a26e01b14774eaeb88ff92ddebd90f0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.847708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a26e01b14774eaeb88ff92ddebd90f0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.850997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.857284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.859212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.877133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1050/2093] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:26.878143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.889666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3825-2c36-4659-a7bb-929f6794e234 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:26.898288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:26.899433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:26.899896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:26.900421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:26.902468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:26.906820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:26.929124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a26e01b14774eaeb88ff92ddebd90f0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.958759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a26e01b14774eaeb88ff92ddebd90f0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.960857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a26e01b14774eaeb88ff92ddebd90f0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.962127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a26e01b14774eaeb88ff92ddebd90f0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.966030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1051/2094] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:26 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:26.967326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:26.982784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-784d1e0a-e95d-4096-8c6e-9d038973bfc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a26e01b14774eaeb88ff92ddebd90f0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:26.985464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.007048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1044/2095] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:26 2022] DELETE /identity/v3/users/4a26e01b14774eaeb88ff92ddebd90f0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:27.011526 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.011821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.012098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.051443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:27.053363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.141952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9037b3-db66-4fea-a114-1d88d60feb62 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.147639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.148430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.148781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.149123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.152705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.152843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1045/2096] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:27.152960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.170521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.173965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.186571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1052/2097] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:26 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:27.189437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.211025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b5b90-cc63-45b0-9f96-e57feca6a037 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.220180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.221403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.221696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.221975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.223546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.226422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.242421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1053/2098] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:27.246601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.263610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d446-108a-485b-8a6c-a8e97a199146 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.265110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7c53-bd35-4ab5-8883-bec7a5836bd4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.268691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.269444 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.269876 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.270306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.270658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.271851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.272267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.272421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.273015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.274740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.283926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.285776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909fe77-6a56-400e-9755-b52484cae4b0 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.293018 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1054/2099] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:27.297095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.299153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1046/2100] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:27.308989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dac054-4903-45e8-b5d1-6d1ddaa553a5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.314068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.315020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.315414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.315755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] PATH_INFO: `/v3/projects/578476c9e9d34e43a94dbc97ee123dea/users/fc55d6358b3d40ad95e6757e8ffa6a4c/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.334772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=578476c9e9d34e43a94dbc97ee123dea, user_id=fc55d6358b3d40ad95e6757e8ffa6a4c, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.337527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.351409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1055/2101] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:27 2022] PUT /identity/v3/projects/578476c9e9d34e43a94dbc97ee123dea/users/fc55d6358b3d40ad95e6757e8ffa6a4c/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:27.362388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.363075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.363075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.393717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] MFA Rules not processed for user `fc55d6358b3d40ad95e6757e8ffa6a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:27.395552 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.471387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1047/2102] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:27.482647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.484420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.555937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e4bfe-7eaa-404f-abcb-46903fd2821d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.559412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.560944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.561477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.562127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.562413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.562801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.572167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.573653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.586958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1056/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:27.659632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b34fe-4eca-432f-9b1d-722a9c94f78e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.666055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.666935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.667219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.667495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] PATH_INFO: `/v3/projects/c86e3556b80c4de48963d5509f31110f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.672384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86e3556b80c4de48963d5509f31110f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.678455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.747991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86e3556b80c4de48963d5509f31110f', 'request_id': 'req-2cac9a46-b083-403d-ae23-18e52fc92d3c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:27.758295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86e3556b80c4de48963d5509f31110f', 'request_id': 'req-2cac9a46-b083-403d-ae23-18e52fc92d3c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:27.774360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86e3556b80c4de48963d5509f31110f', 'request_id': 'req-2cac9a46-b083-403d-ae23-18e52fc92d3c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:27.788966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] The token cache is being invalidate because project c86e3556b80c4de48963d5509f31110f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:27.789479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:27.790515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:27.793567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1048/2104] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:27 2022] DELETE /identity/v3/projects/c86e3556b80c4de48963d5509f31110f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:27.799106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.815449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070088e4-cd66-4150-949e-5c35fb0ca057 service glance] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.865247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:27.867667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:27.955302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.958795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.959381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.960497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] PATH_INFO: `/v3/users/6def1ad1bcd546b297c986af8e7550e5` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.964184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6def1ad1bcd546b297c986af8e7550e5)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:27.967289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:27.976324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac9a46-b083-403d-ae23-18e52fc92d3c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:27.990560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:27.992871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:27.993354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:27.994126 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] PATH_INFO: `/v3/projects/24f4fe1fc63045b1a13819c47db3a6e7` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:27.997479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f4fe1fc63045b1a13819c47db3a6e7)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:28.004170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:28.045391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6def1ad1bcd546b297c986af8e7550e5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.081622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6def1ad1bcd546b297c986af8e7550e5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.082784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6def1ad1bcd546b297c986af8e7550e5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.084354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6def1ad1bcd546b297c986af8e7550e5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.100996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f4fe1fc63045b1a13819c47db3a6e7', 'request_id': 'req-f168cf9b-c488-4cac-a716-53c657f69f61'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.108240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6def1ad1bcd546b297c986af8e7550e5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.113417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f4fe1fc63045b1a13819c47db3a6e7', 'request_id': 'req-f168cf9b-c488-4cac-a716-53c657f69f61'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.127725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f4fe1fc63045b1a13819c47db3a6e7', 'request_id': 'req-f168cf9b-c488-4cac-a716-53c657f69f61'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.148572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] The token cache is being invalidate because project 24f4fe1fc63045b1a13819c47db3a6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:28.148860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.149563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.150998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1057/2105] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:27 2022] DELETE /identity/v3/users/6def1ad1bcd546b297c986af8e7550e5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:28.155021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1049/2106] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:27 2022] DELETE /identity/v3/projects/24f4fe1fc63045b1a13819c47db3a6e7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:28.167655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:28.183767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:28.316106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5354cb-dd94-48d8-ab1e-c3e0daa2e6b8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:28.329349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:28.331686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:28.332981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:28.333305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] PATH_INFO: `/v3/users/96b0a05cd2a74fc58e03f7efc1c40583` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:28.336759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b0a05cd2a74fc58e03f7efc1c40583)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:28.343289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:28.454642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b0a05cd2a74fc58e03f7efc1c40583'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.479905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b0a05cd2a74fc58e03f7efc1c40583'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.480796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b0a05cd2a74fc58e03f7efc1c40583'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.481752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b0a05cd2a74fc58e03f7efc1c40583'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.496671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b0a05cd2a74fc58e03f7efc1c40583'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:28.522012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1058/2107] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:28 2022] DELETE /identity/v3/users/96b0a05cd2a74fc58e03f7efc1c40583 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:28.932142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:28.934249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.014281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168cf9b-c488-4cac-a716-53c657f69f61 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.034440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.039015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.092742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.095381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.095868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.096568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] PATH_INFO: `/v3/projects/52bab4bf28ea41f189bda309935f78dd` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.100105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bab4bf28ea41f189bda309935f78dd)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.104559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.136650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd69c8e-44be-4d41-aec0-c70a398b9aec admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.141738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.142591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.142960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.143500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] PATH_INFO: `/v3/projects/33fa93c7242f4682ad90ec195ee36763` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.144987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fa93c7242f4682ad90ec195ee36763)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.150732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.182793 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bab4bf28ea41f189bda309935f78dd', 'request_id': 'req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.191316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bab4bf28ea41f189bda309935f78dd', 'request_id': 'req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.199230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bab4bf28ea41f189bda309935f78dd', 'request_id': 'req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.207883 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fa93c7242f4682ad90ec195ee36763', 'request_id': 'req-09788167-a617-4007-b242-242e526f5e2a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.210581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] The token cache is being invalidate because project 52bab4bf28ea41f189bda309935f78dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:29.210963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.211643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.213249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1050/2108] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:28 2022] DELETE /identity/v3/projects/52bab4bf28ea41f189bda309935f78dd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:29.214910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fa93c7242f4682ad90ec195ee36763', 'request_id': 'req-09788167-a617-4007-b242-242e526f5e2a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.217150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.218515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.228829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fa93c7242f4682ad90ec195ee36763', 'request_id': 'req-09788167-a617-4007-b242-242e526f5e2a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.239870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] The token cache is being invalidate because project 33fa93c7242f4682ad90ec195ee36763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:29.240150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.240816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-09788167-a617-4007-b242-242e526f5e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.242354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1059/2109] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:29 2022] DELETE /identity/v3/projects/33fa93c7242f4682ad90ec195ee36763 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:29.246959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0974-d8d5-47cf-988f-4b94f1baca43 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.247241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0974-d8d5-47cf-988f-4b94f1baca43 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.247522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0974-d8d5-47cf-988f-4b94f1baca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.267431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-300f0974-d8d5-47cf-988f-4b94f1baca43 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:29.269120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-300f0974-d8d5-47cf-988f-4b94f1baca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.297814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d94cb-b87e-4b97-a873-9ee91eba0c03 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.373949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1060/2110] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:29.374776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.375075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.376759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.379536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.380643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.380921 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.381534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] PATH_INFO: `/v3/users/40f4343ce26040c5b90307523e2fa119` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.382818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f4343ce26040c5b90307523e2fa119)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.385981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.410936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:29.413731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.424948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1061/2111] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:29.429863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.441822 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa9166-5028-4054-961c-c0bd96ed78af None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.444615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f4343ce26040c5b90307523e2fa119'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.449168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.450112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.450570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.450990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.452189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:29.452676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.454719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.457910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f4343ce26040c5b90307523e2fa119'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.459266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f4343ce26040c5b90307523e2fa119'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.459881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f4343ce26040c5b90307523e2fa119'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.467162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f4343ce26040c5b90307523e2fa119'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.475741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1062/2112] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:29.480069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.481790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.482254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1051/2113] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:29 2022] DELETE /identity/v3/users/40f4343ce26040c5b90307523e2fa119 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:29.498973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1160a0-64f3-4df6-bd4c-f470ea6ab00a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.561569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.562250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.562542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.562825 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.563623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.565915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.594620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1063/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:29.598989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.609954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b805-e071-4cb6-9749-c772081eed0a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.679908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.680635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.680927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.681209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.681916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.683906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.706510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1052/2115] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:29.710471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.721732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754b69-ed14-4b67-9c43-5f4ad438bb6e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.727268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.727940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.728231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.728541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.729282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.730997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.741747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1064/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:29.745678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.760772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9155ed9-4ed3-4ce5-bdfd-c1bd5028ab81 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.766388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.768047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.768373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.768802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.770065 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.772697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.783994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1053/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:29.788709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.798902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.803697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.809433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55b2ee-dfc1-41d5-83fe-5d44b2c9c3de admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.816796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.819347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.819638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.819923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] PATH_INFO: `/v3/projects/c6feffa981c54de8afa317df94169130/users/000b91fb59624ee087e21885663bc8c1/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.825312 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b6db-11b8-4df6-9ec0-7b185cc36e3e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:29.831028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:29.832083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.832408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.832693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] PATH_INFO: `/v3/projects/2816bdf629b74d76abf569ae79c2b327` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.834340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2816bdf629b74d76abf569ae79c2b327)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.836244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.846930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6feffa981c54de8afa317df94169130, user_id=000b91fb59624ee087e21885663bc8c1, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:29.849912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be0f28-82df-4242-8736-040aa6f1f238 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:29.864183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1065/2118] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:29 2022] PUT /identity/v3/projects/c6feffa981c54de8afa317df94169130/users/000b91fb59624ee087e21885663bc8c1/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:29.876531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.876820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.877100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.893593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2816bdf629b74d76abf569ae79c2b327', 'request_id': 'req-e2d5862c-0980-4377-8fd2-b45921f7b608'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.902259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2816bdf629b74d76abf569ae79c2b327', 'request_id': 'req-e2d5862c-0980-4377-8fd2-b45921f7b608'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.911119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2816bdf629b74d76abf569ae79c2b327', 'request_id': 'req-e2d5862c-0980-4377-8fd2-b45921f7b608'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.917276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] MFA Rules not processed for user `000b91fb59624ee087e21885663bc8c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:29.918496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.924295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] The token cache is being invalidate because project 2816bdf629b74d76abf569ae79c2b327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:29.924295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.925049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e2d5862c-0980-4377-8fd2-b45921f7b608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:29.927797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1054/2119] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:29 2022] DELETE /identity/v3/projects/2816bdf629b74d76abf569ae79c2b327 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:29.933138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91bb1-274f-4b79-b58f-bad61a7cc412 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:29.933783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91bb1-274f-4b79-b58f-bad61a7cc412 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:29.934080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91bb1-274f-4b79-b58f-bad61a7cc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:29.955024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d6a91bb1-274f-4b79-b58f-bad61a7cc412 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:29.956831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d6a91bb1-274f-4b79-b58f-bad61a7cc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:29.990602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1066/2120] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:29.997779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:29.999497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.030019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1055/2121] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:30.038201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.038604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.038886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.070697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:30.072287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.081109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1056/2122] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:30.085532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.096047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0dd49-14de-42f8-9cc6-4707944e5ca1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.100746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838471e-19b0-4514-a8e4-62959fd24218 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.103278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.104113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.104364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.104638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.106030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:30.106343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.108119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.108443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.109115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.109395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.109706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.110581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.113061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.121216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1057/2123] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:49:30.125617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.136129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d58b6-45e8-46d0-8694-db8accd38416 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.141567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.142378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.142667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.142947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.143646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.145587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.156388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1067/2124] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:29 2022] POST /identity/v3/projects => generated 363 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:30.162300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.180967 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1058/2125] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:30.182486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.233264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562ef9c-0160-416d-99d7-babfd9dc6645 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.246909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87332d-0859-424b-a19a-e474f514b0d3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.252049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.252750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.253038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.253344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.254034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.256047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.277334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1059/2126] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:30.281111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.292749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7348a5f-f558-4967-9f1b-f4fdd4502b75 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.295568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.296253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.296585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.296866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.297422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.297551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.298078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.298360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.298635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.299362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.299530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.301228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.312728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1060/2127] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:30.317032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.321361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1068/2128] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:30.325234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.327657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997161f5-99bd-4c3b-8768-000e8b0a8744 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.332407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.333074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.333362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.333645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.334523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.336200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.337421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2ab27-607c-47f2-8f13-adb7707b2e16 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.343783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.344495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.344780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.345041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.345833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.347546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.350203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1061/2129] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:30.354239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.359970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1069/2130] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:30.363985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.364145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2dda4-5fef-4f6b-89d4-902b7f831bd8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.369766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.370659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.370941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.371506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] PATH_INFO: `/v3/projects/387159c171014bad831535fe0d47dece/users/eb575e20a9434808b7f61a307d5ecc3b/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.377416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fb8e9-4eeb-419a-8182-377c44ba8a5c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.382739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.383723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.383896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.384171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] PATH_INFO: `/v3/projects/cd9e99a3cc3146869637d76302381b41/users/ee04c708763446088a1f7d746b14b1b8/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.394591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387159c171014bad831535fe0d47dece, user_id=eb575e20a9434808b7f61a307d5ecc3b, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.397744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.400225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e99a3cc3146869637d76302381b41, user_id=ee04c708763446088a1f7d746b14b1b8, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.402914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc9edd-c857-4529-bb17-5339758066cb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.414144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1062/2131] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:30 2022] PUT /identity/v3/projects/387159c171014bad831535fe0d47dece/users/eb575e20a9434808b7f61a307d5ecc3b/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:30.426880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1070/2132] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:30 2022] PUT /identity/v3/projects/cd9e99a3cc3146869637d76302381b41/users/ee04c708763446088a1f7d746b14b1b8/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:30.428481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.431513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.431513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.431513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.456456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] MFA Rules not processed for user `eb575e20a9434808b7f61a307d5ecc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:30.457963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.507215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfde1b-8cb5-4eeb-a7f6-18ea69a7d424 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.536382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1071/2133] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:30.558410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.559978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.595934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.596676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.597237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.597522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.598288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.600790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.611593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1063/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:30.615557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.631289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac9bae-3b5d-43da-8ccb-d5632f8f04d3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.637409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.638567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.638853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.639256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] PATH_INFO: `/v3/projects/cd9e99a3cc3146869637d76302381b41/users/ee04c708763446088a1f7d746b14b1b8/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.640812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f93d-1427-422c-bce4-9ad56f2a542f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.641908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e99a3cc3146869637d76302381b41, user_id=ee04c708763446088a1f7d746b14b1b8, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.644875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968a9d8-42fc-4b3c-8f78-77e6584bd3c4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.648320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.649097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.649403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.649676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.659450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1064/2135] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:30 2022] PUT /identity/v3/projects/cd9e99a3cc3146869637d76302381b41/users/ee04c708763446088a1f7d746b14b1b8/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:30.660916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.663506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.674003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.674300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.674567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.678604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1072/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:30.712997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] MFA Rules not processed for user `ee04c708763446088a1f7d746b14b1b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:30.714404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.791472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1065/2137] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:30.805141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:30.806828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:30.819047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b78e-7a65-4ed0-8e85-325d63aad795 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:30.876871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:30.877521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:30.877797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:30.878066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:30.888857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:30.890417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:30.903229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1073/2138] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:31.025496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:31.037934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc0e97-ebb8-4510-b955-d13c0d129c06 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:31.042262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:31.043032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:31.043422 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:31.043796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:31.105498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:31.106958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff37e83-fa2e-4e90-9369-437db5cc2998 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:31.116708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1066/2139] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:33.866358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:33.936383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12807f8-0555-4cca-beda-ac69512a04c8 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:33.940874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:33.941742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:33.942026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:33.942304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] PATH_INFO: `/v3/users/000b91fb59624ee087e21885663bc8c1` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:33.944168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000b91fb59624ee087e21885663bc8c1)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:33.946214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:33.997615 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000b91fb59624ee087e21885663bc8c1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.012787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000b91fb59624ee087e21885663bc8c1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.013985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000b91fb59624ee087e21885663bc8c1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.014599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000b91fb59624ee087e21885663bc8c1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.022492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000b91fb59624ee087e21885663bc8c1'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.041307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1074/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:33 2022] DELETE /identity/v3/users/000b91fb59624ee087e21885663bc8c1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:34.043466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.043977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.044058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.062406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:34.063436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.135443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1067/2141] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:34.145426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:34.149290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.222140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5f607-4701-4785-8e78-2c508e457966 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:34.232478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:34.233370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.233699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.233979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.248519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:34.248875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8542-c37b-440e-96a2-68e972e2c811 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:34.259527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1075/2142] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:34.363413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:34.364913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.377844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16ff7-909b-486c-9060-4e564a7e79d3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:34.387470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:34.388454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.388739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.389049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] PATH_INFO: `/v3/users/eb575e20a9434808b7f61a307d5ecc3b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.390487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb575e20a9434808b7f61a307d5ecc3b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:34.392531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:34.451440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb575e20a9434808b7f61a307d5ecc3b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.469500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb575e20a9434808b7f61a307d5ecc3b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.472509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb575e20a9434808b7f61a307d5ecc3b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.473207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb575e20a9434808b7f61a307d5ecc3b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.482258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb575e20a9434808b7f61a307d5ecc3b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.496193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1068/2143] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:34 2022] DELETE /identity/v3/users/eb575e20a9434808b7f61a307d5ecc3b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:34.500962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.501318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.501661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.528161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:34.529371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.598873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:34.601028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.614216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1076/2144] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:34.627891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:34.629628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:34.704154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f204a3-dc4c-4909-8942-374ba7fdf06f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:34.720380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:34.721328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.721618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.722003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] PATH_INFO: `/v3/projects/c6feffa981c54de8afa317df94169130` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.726532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83453-e8a2-42ed-b627-5d81ea57aa22 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:34.726791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6feffa981c54de8afa317df94169130)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:34.730527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:34.731193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:34.731477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:34.731754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:34.735219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:34.761457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:34.763354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:34.782664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1077/2145] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:34.828192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6feffa981c54de8afa317df94169130', 'request_id': 'req-293dcfed-a17c-44d8-aede-68eb5f2d63ab'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.836825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6feffa981c54de8afa317df94169130', 'request_id': 'req-293dcfed-a17c-44d8-aede-68eb5f2d63ab'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.846499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6feffa981c54de8afa317df94169130', 'request_id': 'req-293dcfed-a17c-44d8-aede-68eb5f2d63ab'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.867402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] The token cache is being invalidate because project c6feffa981c54de8afa317df94169130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:34.868035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.868948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:34.874756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1069/2146] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:34 2022] DELETE /identity/v3/projects/c6feffa981c54de8afa317df94169130 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:34.876855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:34.898678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f9a42-7c17-4e35-8514-e1768a55e6c9 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.009130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.012677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.012677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.012677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] PATH_INFO: `/v3/users/ee04c708763446088a1f7d746b14b1b8` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.013794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee04c708763446088a1f7d746b14b1b8)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.018201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.082307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee04c708763446088a1f7d746b14b1b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.097975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee04c708763446088a1f7d746b14b1b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.098878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee04c708763446088a1f7d746b14b1b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.099889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee04c708763446088a1f7d746b14b1b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.120187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee04c708763446088a1f7d746b14b1b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.138390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1078/2147] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:34 2022] DELETE /identity/v3/users/ee04c708763446088a1f7d746b14b1b8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:35.280248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.282089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.307370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcfed-a17c-44d8-aede-68eb5f2d63ab admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.413875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.414837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.415188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.415527 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] PATH_INFO: `/v3/projects/387159c171014bad831535fe0d47dece` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.416836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] RBAC: Authorizing `identity:delete_project(project_id=387159c171014bad831535fe0d47dece)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.419609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.481740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387159c171014bad831535fe0d47dece', 'request_id': 'req-159045b1-ff8b-4ee5-8b21-94019a56254c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.490464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387159c171014bad831535fe0d47dece', 'request_id': 'req-159045b1-ff8b-4ee5-8b21-94019a56254c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.508521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387159c171014bad831535fe0d47dece', 'request_id': 'req-159045b1-ff8b-4ee5-8b21-94019a56254c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.520548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.522842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.527738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] The token cache is being invalidate because project 387159c171014bad831535fe0d47dece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:35.528050 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.528705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-159045b1-ff8b-4ee5-8b21-94019a56254c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.530558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1070/2148] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:35 2022] DELETE /identity/v3/projects/387159c171014bad831535fe0d47dece => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:35.540349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776ad0-350d-44e3-aea2-51869c6ab3b6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.540585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776ad0-350d-44e3-aea2-51869c6ab3b6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.540778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7776ad0-350d-44e3-aea2-51869c6ab3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.562833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a958e-a917-4ef4-a57f-478d93f0de3e admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.570355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a7776ad0-350d-44e3-aea2-51869c6ab3b6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:35.571969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a7776ad0-350d-44e3-aea2-51869c6ab3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.639896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.641281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.641706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.642252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] PATH_INFO: `/v3/projects/cd9e99a3cc3146869637d76302381b41` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.643824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9e99a3cc3146869637d76302381b41)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.644787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1071/2149] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:35.646253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.653766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.654177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.654462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.676252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:35.678202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.686602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1072/2150] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:35.691892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.702167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdf190-ff8a-4a32-b6f9-8a99285f3439 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.705578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9e99a3cc3146869637d76302381b41', 'request_id': 'req-fb9f23d5-687f-4df6-8216-4cc5af823c14'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.713233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9e99a3cc3146869637d76302381b41', 'request_id': 'req-fb9f23d5-687f-4df6-8216-4cc5af823c14'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.723132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9e99a3cc3146869637d76302381b41', 'request_id': 'req-fb9f23d5-687f-4df6-8216-4cc5af823c14'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.735282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] The token cache is being invalidate because project cd9e99a3cc3146869637d76302381b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:35.735507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.736335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fb9f23d5-687f-4df6-8216-4cc5af823c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:35.738061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1079/2151] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:35 2022] DELETE /identity/v3/projects/cd9e99a3cc3146869637d76302381b41 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:35.744132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e3a6-6253-4299-9acd-035e34f16364 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.744453 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e3a6-6253-4299-9acd-035e34f16364 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.744764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11e3a6-6253-4299-9acd-035e34f16364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.766683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-df11e3a6-6253-4299-9acd-035e34f16364 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:35.768203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-df11e3a6-6253-4299-9acd-035e34f16364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.769618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.770296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.771494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.771775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.772555 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:35.772862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.774522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.780833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1080/2152] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:35.792153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1073/2153] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:35.792402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.792402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.792402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.793236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.794988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.808122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926b881-6ded-48c4-a0b8-7612ce0d6350 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.810020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:35.811477 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:35.812941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.813625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.813911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.814191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.815329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.817559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.829054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1081/2154] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:35.830257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.844378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b352b-726b-4ff9-ae0a-c9f33f0f2456 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.848493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1074/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:35.850924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.851791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.852103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.852431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.853182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:35.853494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.855250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.856257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.876342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1082/2156] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:35.878077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.889995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c8597-8b7e-4170-81c2-e59ceecfa009 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.945217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aa113-9608-43b4-985f-a63f39d3f07b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:35.958543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.958774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:35.958966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.958966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.958966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.959239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:35.959239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:35.959239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:35.959708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.959804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:35.959888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.959979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:35.984324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1075/2157] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:35.987664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:35.989017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1083/2158] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:35.994271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.005977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f9589-2364-406d-940f-a3b912c97e08 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.081508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb9a1-2cd9-41f0-8d82-0d9f6f61cfd2 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.087435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.088394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.088752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.089091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.089866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.091913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.127239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.128109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.128440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.128723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.129564 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.132360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.132522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1084/2159] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:35 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:36.137727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.152122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1076/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:36.152898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01571-fea2-4561-835f-3d3b50fecb46 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.153983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.162096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.163004 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.163356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.163697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.164800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.167881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.179282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c0248-ec97-4003-b949-83b48b6946ab admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.184323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1085/2161] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:36.186261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.193428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.193852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.194202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.195430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.196250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.199337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ca9ba-3ec1-449b-abc4-81abff0f29a0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.205609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.206736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.207319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.207734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.209743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.212539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.212792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.228225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1086/2162] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:36.232353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.236626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1077/2163] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:36.240238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.248592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412cb6-b4dd-4f3a-aa4f-b2dae0be4622 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.254718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.256076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639d3e-c634-482f-ae80-ed17b31395b4 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.256241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.256487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.256828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] PATH_INFO: `/v3/projects/ce15496987aa43bcbd2c0dee83b57f1b/users/fc796fcac04f4da0af6078249fa55c88/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.264186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.265665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.266185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.266402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] PATH_INFO: `/v3/projects/9cba4b165ecb44ef8c7018958198eb36/users/8de59690354e4f00b10847b64c1166ab/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.285937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cba4b165ecb44ef8c7018958198eb36, user_id=8de59690354e4f00b10847b64c1166ab, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.289568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc68c8-63ea-46f7-a473-541290259493 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.291411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce15496987aa43bcbd2c0dee83b57f1b, user_id=fc796fcac04f4da0af6078249fa55c88, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.294311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53078475-2367-4af8-baad-24c80ed07a3c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.315299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1078/2164] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:36 2022] PUT /identity/v3/projects/9cba4b165ecb44ef8c7018958198eb36/users/8de59690354e4f00b10847b64c1166ab/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:36.328320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.328736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.329519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.332848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1087/2165] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:36 2022] PUT /identity/v3/projects/ce15496987aa43bcbd2c0dee83b57f1b/users/fc796fcac04f4da0af6078249fa55c88/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:36.345459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.345752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.346033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.384013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] MFA Rules not processed for user `8de59690354e4f00b10847b64c1166ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:36.385667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:36.416328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] MFA Rules not processed for user `fc796fcac04f4da0af6078249fa55c88`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:36.417694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:36.491157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1079/2166] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:36.505049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.507820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:36.540715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1088/2167] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:36.544253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.611199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5bfb-74b1-4df1-8c13-0b42c03f1921 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.622927 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.623910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.624226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.624624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.635855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.637488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.649969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1080/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:36.654792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47bd8c-5847-4029-94da-8af5dad287a2 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.662896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.664624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.665186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.665737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.666980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.669734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.704301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1089/2169] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:36 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:36.709902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.721750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908921f-f688-46de-a67d-6695fc285677 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.820023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.820860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.830497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.830497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.830497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.830497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.863890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1081/2170] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:36 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:36.866139 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.878416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30c8b-2ccf-4c23-9846-09391955e5f5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.884065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.884952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.885298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.885635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.886463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.888044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.899850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1090/2171] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:36.904195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.915745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd03d-9bd1-4e9c-ae90-6bccc00eba88 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:36.921437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:36.922722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:36.923013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:36.923410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] PATH_INFO: `/v3/projects/bd8f63d4c8e144759598df83427e074a/users/c8cb4acc71af40d59295dbaed0eb0e6c/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:36.941395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8f63d4c8e144759598df83427e074a, user_id=c8cb4acc71af40d59295dbaed0eb0e6c, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:36.944213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:36.962391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1082/2172] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:36 2022] PUT /identity/v3/projects/bd8f63d4c8e144759598df83427e074a/users/c8cb4acc71af40d59295dbaed0eb0e6c/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:36.968050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:36.997531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8f33-1798-4296-bf87-ee9ad3788fc4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:37.085266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:37.086396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.086905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.087408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.088503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:37.090136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9e759-d548-4dc0-a29d-1755f67b05fd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:37.101588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1091/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:37.105908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:37.116919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4adacae-6273-4aa7-9bff-1e484b42221d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:37.121859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:37.122817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.123103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.123377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] PATH_INFO: `/v3/projects/bd8f63d4c8e144759598df83427e074a/users/c8cb4acc71af40d59295dbaed0eb0e6c/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.125490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd8f63d4c8e144759598df83427e074a, user_id=c8cb4acc71af40d59295dbaed0eb0e6c, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:37.128380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:37.142147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1083/2174] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:37 2022] PUT /identity/v3/projects/bd8f63d4c8e144759598df83427e074a/users/c8cb4acc71af40d59295dbaed0eb0e6c/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:37.152464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.152755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.153034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.189774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] MFA Rules not processed for user `c8cb4acc71af40d59295dbaed0eb0e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:37.191044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:37.278152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1092/2175] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:37.288673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:37.288673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:37.368727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfcbf0-6823-4dad-a7bb-89e34f0f3815 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:37.374098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:37.374866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.375216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.375565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.386242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:37.388064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ab896-88d1-4be2-a900-9d4747874849 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:37.402741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1084/2176] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:37.442140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:37.522481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4d0b-bbaa-44b3-a582-1ed139a4489d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:37.527298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:37.528308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.528710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.529105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] PATH_INFO: `/v3/users/fc796fcac04f4da0af6078249fa55c88` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.530420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc796fcac04f4da0af6078249fa55c88)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:37.537153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:37.595005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc796fcac04f4da0af6078249fa55c88'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:37.614013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc796fcac04f4da0af6078249fa55c88'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:37.614797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc796fcac04f4da0af6078249fa55c88'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:37.615516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc796fcac04f4da0af6078249fa55c88'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:37.623613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc796fcac04f4da0af6078249fa55c88'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:37.639645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1093/2177] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:37 2022] DELETE /identity/v3/users/fc796fcac04f4da0af6078249fa55c88 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:37.644953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89adf3-5356-49d5-bcb8-98787e5d1754 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.645364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89adf3-5356-49d5-bcb8-98787e5d1754 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.646331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89adf3-5356-49d5-bcb8-98787e5d1754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.667156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3d89adf3-5356-49d5-bcb8-98787e5d1754 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:37.667156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3d89adf3-5356-49d5-bcb8-98787e5d1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:37.767584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1085/2178] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:37.781557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:37.783309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:37.886593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4363c-953f-4edd-97ea-1095c4e6e298 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:37.890404 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:37.891282 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:37.891665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:37.892054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:37.902514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:37.904077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:37.915895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1094/2179] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:38.078741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:38.079293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:38.079650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:38.108000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] MFA Rules not processed for user `8de59690354e4f00b10847b64c1166ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:38.109366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:38.179278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1086/2180] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:38.257778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:38.262795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:38.281110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa0420-beea-44b0-8ca6-111585f96c9f service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:38.287102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:38.287871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:38.288155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:38.288463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] PATH_INFO: `/v3/projects/ce15496987aa43bcbd2c0dee83b57f1b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:38.289701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce15496987aa43bcbd2c0dee83b57f1b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:38.291738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:38.354878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce15496987aa43bcbd2c0dee83b57f1b', 'request_id': 'req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.361136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce15496987aa43bcbd2c0dee83b57f1b', 'request_id': 'req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.370043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce15496987aa43bcbd2c0dee83b57f1b', 'request_id': 'req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.381965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] The token cache is being invalidate because project ce15496987aa43bcbd2c0dee83b57f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:38.382254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.382900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.384587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1095/2181] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:38 2022] DELETE /identity/v3/projects/ce15496987aa43bcbd2c0dee83b57f1b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:38.388861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:38.402541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c23084-05ca-4b38-a42b-0055aba22a2b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:38.463186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:38.464344 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:38.464636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:38.465040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] PATH_INFO: `/v3/users/c8cb4acc71af40d59295dbaed0eb0e6c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:38.466429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cb4acc71af40d59295dbaed0eb0e6c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:38.468587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:38.519795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cb4acc71af40d59295dbaed0eb0e6c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.542446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cb4acc71af40d59295dbaed0eb0e6c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.543094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cb4acc71af40d59295dbaed0eb0e6c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.543719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cb4acc71af40d59295dbaed0eb0e6c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.552476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14e3fb5b-981d-4b3b-a467-811cf2d32aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cb4acc71af40d59295dbaed0eb0e6c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:38.568723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1087/2182] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:38 2022] DELETE /identity/v3/users/c8cb4acc71af40d59295dbaed0eb0e6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:38.965239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:38.966905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:38.980713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfb60c-0c30-4aaf-99cb-7baadf9c9da3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.052989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.053954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.054399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.054513 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] PATH_INFO: `/v3/projects/bd8f63d4c8e144759598df83427e074a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.055720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd8f63d4c8e144759598df83427e074a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.058309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.112082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd8f63d4c8e144759598df83427e074a', 'request_id': 'req-31156b38-1db1-4695-ad18-40b801cfff84'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:39.119345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd8f63d4c8e144759598df83427e074a', 'request_id': 'req-31156b38-1db1-4695-ad18-40b801cfff84'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:39.148516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd8f63d4c8e144759598df83427e074a', 'request_id': 'req-31156b38-1db1-4695-ad18-40b801cfff84'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:39.160862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] The token cache is being invalidate because project bd8f63d4c8e144759598df83427e074a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:39.163207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:39.163207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-31156b38-1db1-4695-ad18-40b801cfff84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:39.164535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1096/2183] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:38 2022] DELETE /identity/v3/projects/bd8f63d4c8e144759598df83427e074a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:39.169209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.169698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.169982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.188704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:39.190016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:39.261030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1088/2184] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:39.266485 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.266808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.267085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.289325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:39.290743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:39.304708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1097/2185] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:39.309093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.319753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf8f0d-20cc-417b-87ad-afe8c7857654 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.324684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.325566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.325859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.326139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.326886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:39.327199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.328903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.344383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1089/2186] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:39.349521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.358797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd410a7-e152-47b8-9834-adaf6e7193ff None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.363427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.364077 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.364588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.364871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.365767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.367701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.395218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1098/2187] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:39.400394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.410932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60460-c607-4fdd-ba6e-60f5b52cb1f6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.472293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.472993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.473282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.473604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.474846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.476819 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.497587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1090/2188] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:39.501760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.513127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d970ee5-79a4-4f32-9ca9-1a2ec89319fc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.518073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.518771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.519069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.519367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.520142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.522778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.535394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1099/2189] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:39.539963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.551521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69550f-a01c-4ba3-9af5-2fd039a6d73d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.557377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.557995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.558284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.558568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.559306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.560998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72655783-e1c6-4d18-85ec-d2697342e511 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.573093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1091/2190] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:39.576696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.586950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ee83-81e7-4b66-a881-745e66f06fc7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.591640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.592543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.592827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.593118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] PATH_INFO: `/v3/projects/48554c0d5de74f2c92502405cdb7f29a/users/1520b7f52152421fa4023d397f758ff6/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.608470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48554c0d5de74f2c92502405cdb7f29a, user_id=1520b7f52152421fa4023d397f758ff6, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.611390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.627575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1100/2191] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:39 2022] PUT /identity/v3/projects/48554c0d5de74f2c92502405cdb7f29a/users/1520b7f52152421fa4023d397f758ff6/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:39.641762 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.642466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.643020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.683465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] MFA Rules not processed for user `1520b7f52152421fa4023d397f758ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:39.684761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:39.757089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1092/2192] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:39.761707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.833494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab62674-880d-4c54-995f-c92f50644558 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.838335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.839029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.839299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.839570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.840308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.842243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.873947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1101/2193] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:39.878078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:39.891103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8395360-de32-4c57-8b1e-dbef4ab1defe None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:39.955320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:39.956002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:39.956303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:39.956595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:39.957283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:39.959483 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:39.985137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1093/2194] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:39 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:49:39.989014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.001482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275647-8bd7-4be2-a4b5-1876c02f1f45 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.007273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.007947 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.008230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.008551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.009281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.010885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.023674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1102/2195] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:49:40.027831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.038859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780aa07-9b6b-4e91-9e77-1f114b7a2eed admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.043578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.044507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.044802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.045083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] PATH_INFO: `/v3/projects/357a6027c9f6452fbe743210f5fa2192/users/2fccfe462eca4b998447b103f6627cfd/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.064559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357a6027c9f6452fbe743210f5fa2192, user_id=2fccfe462eca4b998447b103f6627cfd, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.067823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.083468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1094/2196] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:40 2022] PUT /identity/v3/projects/357a6027c9f6452fbe743210f5fa2192/users/2fccfe462eca4b998447b103f6627cfd/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:40.089413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.100587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25725c-cfbd-4214-b1c6-451289eb1b95 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.161696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.162651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.162820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.163069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.163804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.165451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517a1da-a89a-42a7-8093-8595ac22d080 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.176319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1103/2197] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:40.181592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.191946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732f966-d149-4d76-a4b4-f5cd73a768a9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.197007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.197898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.198190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.198466 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] PATH_INFO: `/v3/projects/357a6027c9f6452fbe743210f5fa2192/users/2fccfe462eca4b998447b103f6627cfd/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.200531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357a6027c9f6452fbe743210f5fa2192, user_id=2fccfe462eca4b998447b103f6627cfd, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.203464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.227855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1095/2198] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:40 2022] PUT /identity/v3/projects/357a6027c9f6452fbe743210f5fa2192/users/2fccfe462eca4b998447b103f6627cfd/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:40.232568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.232863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.233144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.263853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] MFA Rules not processed for user `2fccfe462eca4b998447b103f6627cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:40.265181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:40.342399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1104/2199] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:40.354334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.356120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:40.431205 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef2ece-60c4-47f2-8f78-5bb04edaa3b4 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.438225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.438886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.439176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.439457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.449765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.451209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.462346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1096/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:40.519522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:40.521711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:40.535445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433517c0-9ea2-4910-8d5a-682434ba4c1e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:40.544315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:40.544315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:40.544315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:40.544315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:40.620819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:40.622275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cb374-762f-42ac-84a1-9c83abe4d9ab service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:40.634553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1105/2201] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:44.074490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:44.154593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96663e83-90dd-4905-85f0-de99b6da3d9c service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:44.159131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:44.160007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:44.160317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:44.160600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] PATH_INFO: `/v3/users/1520b7f52152421fa4023d397f758ff6` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:44.161926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1520b7f52152421fa4023d397f758ff6)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:44.163877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:44.242663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1520b7f52152421fa4023d397f758ff6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:44.268537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1520b7f52152421fa4023d397f758ff6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:44.269689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1520b7f52152421fa4023d397f758ff6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:44.271018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1520b7f52152421fa4023d397f758ff6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:44.288702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1520b7f52152421fa4023d397f758ff6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:44.307425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1097/2202] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:44 2022] DELETE /identity/v3/users/1520b7f52152421fa4023d397f758ff6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:44.313156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:44.314310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:44.314664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:44.341141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:44.342550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:44.419790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1106/2203] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:44.426457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:44.428656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:44.506951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394580dc-e860-4749-b08b-31ae9903c9c5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:44.513838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:44.515223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:44.515698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:44.516254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:44.541238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:44.542718 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:44.554998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1098/2204] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:44.962894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:44.966083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:44.982982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6df2e-ec49-4d02-b0eb-c4edab6d0fd1 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:45.003355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:45.006120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:45.006702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:45.007717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] PATH_INFO: `/v3/projects/48554c0d5de74f2c92502405cdb7f29a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:45.011438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48554c0d5de74f2c92502405cdb7f29a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:45.015933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:45.090923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48554c0d5de74f2c92502405cdb7f29a', 'request_id': 'req-809fc936-8614-4c79-b3c0-15702a82e3d2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.098039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48554c0d5de74f2c92502405cdb7f29a', 'request_id': 'req-809fc936-8614-4c79-b3c0-15702a82e3d2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.106728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48554c0d5de74f2c92502405cdb7f29a', 'request_id': 'req-809fc936-8614-4c79-b3c0-15702a82e3d2'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.118049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] The token cache is being invalidate because project 48554c0d5de74f2c92502405cdb7f29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:45.118684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.119561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.121556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1107/2205] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:44 2022] DELETE /identity/v3/projects/48554c0d5de74f2c92502405cdb7f29a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:45.125765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:45.137439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81de7fc-58af-4573-badb-cf43414d425d service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:45.253660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:45.255549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:45.256077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:45.257010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] PATH_INFO: `/v3/users/2fccfe462eca4b998447b103f6627cfd` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:45.258834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fccfe462eca4b998447b103f6627cfd)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:45.261534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:45.363261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fccfe462eca4b998447b103f6627cfd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.394993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fccfe462eca4b998447b103f6627cfd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.397412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fccfe462eca4b998447b103f6627cfd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.398106 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fccfe462eca4b998447b103f6627cfd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.415023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4db55fe1-77c4-481a-a4a1-825c71e30390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fccfe462eca4b998447b103f6627cfd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.448253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1099/2206] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:45 2022] DELETE /identity/v3/users/2fccfe462eca4b998447b103f6627cfd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:45.784807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:45.787039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:45.800036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fc936-8614-4c79-b3c0-15702a82e3d2 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:45.864655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:45.865647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:45.865935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:45.866211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] PATH_INFO: `/v3/projects/357a6027c9f6452fbe743210f5fa2192` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:45.867437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=357a6027c9f6452fbe743210f5fa2192)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:45.869434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:45.920967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357a6027c9f6452fbe743210f5fa2192', 'request_id': 'req-781752d5-6981-4050-af47-17742ce86394'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.927572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357a6027c9f6452fbe743210f5fa2192', 'request_id': 'req-781752d5-6981-4050-af47-17742ce86394'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.936210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357a6027c9f6452fbe743210f5fa2192', 'request_id': 'req-781752d5-6981-4050-af47-17742ce86394'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.951327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] The token cache is being invalidate because project 357a6027c9f6452fbe743210f5fa2192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:49:45.951614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.952254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-781752d5-6981-4050-af47-17742ce86394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:45.954076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1108/2207] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:49:45 2022] DELETE /identity/v3/projects/357a6027c9f6452fbe743210f5fa2192 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:45.961260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:45.961912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:45.962416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:45.988864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:45.990145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:46.055664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1100/2208] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:46.069078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.069396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.069668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.089119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:46.090368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:46.098704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1109/2209] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:46.103403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.113590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cbc44-c706-499b-9042-259b7aca60f2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.118342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.119016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.119302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.119572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.120319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:49:46.120699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.122274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.134724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1101/2210] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:49:46.139614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.150959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfeb6e0-dc99-49b0-9602-419cc6451666 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.155738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.156433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.156720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.156997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.157691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.159673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.188769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1110/2211] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:46.193689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.204116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8de5e0-ded1-4d57-8d70-595d0af5b204 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.264457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.264457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.264457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.264457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.265039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.266638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.289871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1102/2212] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/users => generated 304 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:46.294304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.306795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7225-2217-44fb-a9b8-2cf2cba8c8c4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.311311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.311968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.312255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.312562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.313320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.314949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.326483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1111/2213] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:46.330581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.347199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65853dd5-b546-4163-af10-5071fcc12742 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.354288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.355381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.355864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.356405 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.357782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.360111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61183bcb-9abf-465e-b9dc-a7f8a095b89c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.373447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1103/2214] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:46.377622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.388962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bef3e-364c-4da6-8eb1-3d83a151d536 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.394808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.395767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.396056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.396377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] PATH_INFO: `/v3/projects/cb20caa62529438bb88b8be2bf26d51e/users/0d06a7ff277e407b8cb5bd3c53c3c018/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.414460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb20caa62529438bb88b8be2bf26d51e, user_id=0d06a7ff277e407b8cb5bd3c53c3c018, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.417165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.434515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1112/2215] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:46 2022] PUT /identity/v3/projects/cb20caa62529438bb88b8be2bf26d51e/users/0d06a7ff277e407b8cb5bd3c53c3c018/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:46.445628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.445909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.446183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.474245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] MFA Rules not processed for user `0d06a7ff277e407b8cb5bd3c53c3c018`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:46.475451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:46.549021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1104/2216] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:49:46.554719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.639863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffcb7d-4f97-40c4-8981-8c8a82ede2d8 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.646256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.646983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.647428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.647738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.648456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.652333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.682503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1113/2217] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:46.686988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.700243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573f40-c04f-4d3b-8340-ce8c2d4f0211 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.770056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.770771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.771078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.771359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.772052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.774036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.795633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1105/2218] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:49:46 2022] POST /identity/v3/users => generated 310 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:49:46.799835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.810939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776d238-8f76-4c47-adf4-47e743f13ac1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.815784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.816452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.816744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.817057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.818230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.819857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.831618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1114/2219] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:46.836190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.846426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1227b6a-23ee-47c7-8330-564087962afc admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.854431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.855378 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.855696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.855977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] PATH_INFO: `/v3/projects/239fcd2b6e614b919780b090e1d53f7a/users/adaf770929814681bdf032791af44278/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.872095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239fcd2b6e614b919780b090e1d53f7a, user_id=adaf770929814681bdf032791af44278, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.874821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.894782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1106/2220] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:46 2022] PUT /identity/v3/projects/239fcd2b6e614b919780b090e1d53f7a/users/adaf770929814681bdf032791af44278/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:46.896903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:46.907403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2efeef-7fa3-4600-a9d4-2821ad6fdb67 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:46.973792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:46.974943 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:46.975251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:46.975531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:46.976569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:46.979686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aaf878-0e47-412e-b8a3-3307a58f5b5e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:46.996553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1115/2221] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:49:47.000725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:47.011842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b55a2d-5dc4-4881-8072-cb714f225254 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:47.016850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:47.018565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:47.018565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:47.018894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] PATH_INFO: `/v3/projects/239fcd2b6e614b919780b090e1d53f7a/users/adaf770929814681bdf032791af44278/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:47.021471 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239fcd2b6e614b919780b090e1d53f7a, user_id=adaf770929814681bdf032791af44278, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:47.024726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:47.038798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1107/2222] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:49:46 2022] PUT /identity/v3/projects/239fcd2b6e614b919780b090e1d53f7a/users/adaf770929814681bdf032791af44278/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:47.048781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649539-5119-4725-ab37-1e3782f41292 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:47.049135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649539-5119-4725-ab37-1e3782f41292 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:47.049359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91649539-5119-4725-ab37-1e3782f41292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:47.076748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-91649539-5119-4725-ab37-1e3782f41292 None None] MFA Rules not processed for user `adaf770929814681bdf032791af44278`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:47.077884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-91649539-5119-4725-ab37-1e3782f41292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:47.164968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1116/2223] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:47.175758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:47.177875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:47.234488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8512e0-03c1-4404-8644-d19e79f27474 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:47.238078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:47.238722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:47.239069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:47.239347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:47.248974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:47.250415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859591-e325-4b7a-9442-fe307aec319a service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:47.262956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1108/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:47.430489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649539-5119-4725-ab37-1e3782f41292 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:47.432257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-91649539-5119-4725-ab37-1e3782f41292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:47.447302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91649539-5119-4725-ab37-1e3782f41292 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:47.450958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:47.451702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:47.452053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:47.454403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:47.518406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:47.519863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:47.529386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1117/2225] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:49:49.752488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:49.753010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:49.753101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:49.773088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:49.774307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:49.833529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1109/2226] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:49.886571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:49.887968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:49.977858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848abd1-bcca-404c-90c0-bc7b21d52278 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:49.983016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:49.983663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:49.983949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:49.984213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:49.995557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:49.997457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:50.010280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1118/2227] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:49:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:49:58.588337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:58.682117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:58.684209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:58.722195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed377321-6249-4cfc-990e-45cfac50f028 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:58.736238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:58.737246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:58.737628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:58.737997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] PATH_INFO: `/v3/users/0d06a7ff277e407b8cb5bd3c53c3c018` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:58.740772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d06a7ff277e407b8cb5bd3c53c3c018)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:58.743112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:58.762845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd009d-3adf-498c-8d55-026b25891215 service swift] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:58.768720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:58.769598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:58.770112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:58.770948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] PATH_INFO: `/v3/users/fc55d6358b3d40ad95e6757e8ffa6a4c` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:58.772251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc55d6358b3d40ad95e6757e8ffa6a4c)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:58.774553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:58.844039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d06a7ff277e407b8cb5bd3c53c3c018'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.867434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d06a7ff277e407b8cb5bd3c53c3c018'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.870560 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d06a7ff277e407b8cb5bd3c53c3c018'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.872984 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d06a7ff277e407b8cb5bd3c53c3c018'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.874457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc55d6358b3d40ad95e6757e8ffa6a4c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.884223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-011f4e0c-b14a-4a83-bce5-3b54796980c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d06a7ff277e407b8cb5bd3c53c3c018'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.897309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc55d6358b3d40ad95e6757e8ffa6a4c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.898601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc55d6358b3d40ad95e6757e8ffa6a4c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.899874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc55d6358b3d40ad95e6757e8ffa6a4c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.902096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1110/2228] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:58 2022] DELETE /identity/v3/users/0d06a7ff277e407b8cb5bd3c53c3c018 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:49:58.921367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4305-4384-4423-9946-282819bba302 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:58.921367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4305-4384-4423-9946-282819bba302 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:58.926972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-91541f5d-1edc-4929-90dc-c0979dfe022e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc55d6358b3d40ad95e6757e8ffa6a4c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:49:58.927146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4305-4384-4423-9946-282819bba302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:58.969197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-134b4305-4384-4423-9946-282819bba302 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:58.971393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-134b4305-4384-4423-9946-282819bba302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:58.976260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1119/2229] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:49:58 2022] DELETE /identity/v3/users/fc55d6358b3d40ad95e6757e8ffa6a4c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:49:58.981296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:58.981940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:58.982770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:59.033944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:49:59.037219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:59.066408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1111/2230] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:59.074162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4305-4384-4423-9946-282819bba302 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:59.075623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-134b4305-4384-4423-9946-282819bba302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:59.166839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1120/2231] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:49:59.190814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:49:59.197132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:49:59.259121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4305-4384-4423-9946-282819bba302 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:59.263715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:59.265098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:59.265400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:59.265677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:59.281572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:59.283175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:59.295210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1112/2232] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:49:59.419645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a982-1073-417a-9a41-9f1d9dede83a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:49:59.473329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:49:59.474476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:49:59.474918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:49:59.475347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:49:59.489734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:49:59.493755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b338a-e0a3-4555-b6a5-278b30063d07 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:49:59.508842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1121/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:00.135323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.138103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:00.183621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22291-b749-485f-a62e-07928f2137ab service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.195820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.197997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.198825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.199938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] PATH_INFO: `/v3/projects/578476c9e9d34e43a94dbc97ee123dea` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.206453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578476c9e9d34e43a94dbc97ee123dea)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.211824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:00.318926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578476c9e9d34e43a94dbc97ee123dea', 'request_id': 'req-80a36148-0f6e-4987-ad98-2f34f0179198'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.334581 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578476c9e9d34e43a94dbc97ee123dea', 'request_id': 'req-80a36148-0f6e-4987-ad98-2f34f0179198'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.349642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578476c9e9d34e43a94dbc97ee123dea', 'request_id': 'req-80a36148-0f6e-4987-ad98-2f34f0179198'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.367416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] The token cache is being invalidate because project 578476c9e9d34e43a94dbc97ee123dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:00.367701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.368631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.370933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1113/2234] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:00 2022] DELETE /identity/v3/projects/578476c9e9d34e43a94dbc97ee123dea => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:00.377568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce979-0014-466d-9b26-5a9711f488d1 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.378083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce979-0014-466d-9b26-5a9711f488d1 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.378251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce979-0014-466d-9b26-5a9711f488d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.452463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-bd7ce979-0014-466d-9b26-5a9711f488d1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:00.454345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bd7ce979-0014-466d-9b26-5a9711f488d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:00.526956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.528606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:00.605873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1122/2235] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:00.609167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.609584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.610087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.631381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:00.632540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a36148-0f6e-4987-ad98-2f34f0179198 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.632723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:00.650703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1123/2236] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:00.655580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.668618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c4aa2-ca61-445f-992b-bb9730a9187d None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.674341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.675029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.675312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.675619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.676810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:00.678116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.680383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:00.683213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.686096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.693734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.695143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] PATH_INFO: `/v3/projects/cb20caa62529438bb88b8be2bf26d51e` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.695545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1124/2237] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:50:00.700508 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb20caa62529438bb88b8be2bf26d51e)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.701558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.705812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:00.714473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ebbff-ad10-4654-908c-0a66e6273f76 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.719420 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.720934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.721328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.721699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.722752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.725538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:00.764666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1125/2238] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:00 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:00.766503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.798783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb20caa62529438bb88b8be2bf26d51e', 'request_id': 'req-85cc5215-76bd-4be3-937d-e1269a50a924'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.807888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb20caa62529438bb88b8be2bf26d51e', 'request_id': 'req-85cc5215-76bd-4be3-937d-e1269a50a924'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.825490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb20caa62529438bb88b8be2bf26d51e', 'request_id': 'req-85cc5215-76bd-4be3-937d-e1269a50a924'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.840442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] The token cache is being invalidate because project cb20caa62529438bb88b8be2bf26d51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:00.840594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.841224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:00.842839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:00 2022] DELETE /identity/v3/projects/cb20caa62529438bb88b8be2bf26d51e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:00.849897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:00.853544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:00.884930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a387e2-ef63-44c0-90e9-927966aa9d46 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.946805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5215-76bd-4be3-937d-e1269a50a924 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:00.956972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.957913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.958196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.958472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] PATH_INFO: `/v3/users/adaf770929814681bdf032791af44278` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.959822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaf770929814681bdf032791af44278)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.961899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:00.979735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:00.980961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:00.981497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:00.982639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:00.983976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:00.986736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.013619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1126/2240] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:00 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:01.019136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:01.021279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:01.033144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6dadd-63c7-4e68-afbd-380aded13594 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:01.038793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:01.041904 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.042214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.042697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.043297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:01.044810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaf770929814681bdf032791af44278'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.044926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.058964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1127/2241] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:01.062658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaf770929814681bdf032791af44278'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.063021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:01.063739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaf770929814681bdf032791af44278'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.064763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaf770929814681bdf032791af44278'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.067916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:01.074133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaf770929814681bdf032791af44278'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.085662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2810e0-a2ca-4d26-8e12-46521884fc8c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:01.091678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:01.092428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.092785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.092992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.093720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:01.096424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1451e0b-e920-41ea-a9bd-fd37df99a731 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.115297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1115/2242] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:00 2022] DELETE /identity/v3/users/adaf770929814681bdf032791af44278 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:01.122573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1128/2243] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:01.123959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:01.239529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96a4ff-4e10-4227-b4c2-1f8da2e6ada6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:01.257215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:01.268037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.271429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.273146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] PATH_INFO: `/v3/projects/840127a9fe414efda3cc5fa6142256bd/users/8da65bee4c8c455d8dd8846778d7821a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.303246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840127a9fe414efda3cc5fa6142256bd, user_id=8da65bee4c8c455d8dd8846778d7821a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:01.307285 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.342601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1116/2244] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:01 2022] PUT /identity/v3/projects/840127a9fe414efda3cc5fa6142256bd/users/8da65bee4c8c455d8dd8846778d7821a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:01.356068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.356441 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.356732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.394345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] MFA Rules not processed for user `8da65bee4c8c455d8dd8846778d7821a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:01.396647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:01.491938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:01.493937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:01.613267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1129/2245] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:01.618227 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:01.621198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:01.646612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a03fb5-f706-4813-81cf-ce6d7032b704 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:01.667796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:01.668713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.669002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.669272 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] PATH_INFO: `/v3/projects/239fcd2b6e614b919780b090e1d53f7a` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.671177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=239fcd2b6e614b919780b090e1d53f7a)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:01.677426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.739181 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61449-698f-49ba-b228-aae80f2177e9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:01.746909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:01.748525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.748845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.749311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.767116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:01.767116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dd50e-68a0-4cc9-949c-6cb1e93723aa service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:01.775677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1130/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:01.809077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239fcd2b6e614b919780b090e1d53f7a', 'request_id': 'req-9296282d-3f90-458e-9006-66649c62a34f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.825296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239fcd2b6e614b919780b090e1d53f7a', 'request_id': 'req-9296282d-3f90-458e-9006-66649c62a34f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.841397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239fcd2b6e614b919780b090e1d53f7a', 'request_id': 'req-9296282d-3f90-458e-9006-66649c62a34f'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.861900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] The token cache is being invalidate because project 239fcd2b6e614b919780b090e1d53f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:01.862208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.864789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9296282d-3f90-458e-9006-66649c62a34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:01.867145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1117/2247] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:01 2022] DELETE /identity/v3/projects/239fcd2b6e614b919780b090e1d53f7a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:01.873273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:01.873685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:01.874079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:01.915296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:01.919929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:02.046580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1131/2248] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:02.049431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.050070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.050504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.086029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:02.087810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:02.111160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1118/2249] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:02.116761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.127375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45bac5-bedb-470b-a6c2-d1b25acf862a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.133896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.134743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.135216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.135643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.136626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:02.137090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.138905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.158778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1132/2250] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:02.160369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.170513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5f8ad-4d6c-42a3-a0c0-2aa70d6f1082 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.177551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.178517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.179018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.179517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.180474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.183354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.223672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1119/2251] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:02.225902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.236881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caffb16-5ef4-420e-8e39-2183a772273b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.347826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.350365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.350867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.351355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.352841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.355088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.388306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1133/2252] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:02.394460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.405794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29eca-9294-48be-98aa-f01b170a389c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.413511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.415296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.415584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.415858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.416658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.418330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.431339 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1120/2253] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:02.434701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.446537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c152d-6c52-4ab2-ac73-81903eedcf6f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.451737 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.452522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.452873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.453222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.454100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.455783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635acb7-2a42-46aa-a00c-35ff076a209e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.466616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1134/2254] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:02.470993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.484543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475450d-a01d-44a8-bb69-1fa06744d819 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.490660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.499263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.499263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.499263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] PATH_INFO: `/v3/projects/5841273087614d058a909829b536e122/users/3588232b4e184c929f27a67830b1992e/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.512501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5841273087614d058a909829b536e122, user_id=3588232b4e184c929f27a67830b1992e, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.515296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.531715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1121/2255] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:02 2022] PUT /identity/v3/projects/5841273087614d058a909829b536e122/users/3588232b4e184c929f27a67830b1992e/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:02.542782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.545129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.545521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.584046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] MFA Rules not processed for user `3588232b4e184c929f27a67830b1992e`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:02.585529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:02.665948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1135/2256] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:02.670178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.743223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36af309-28f6-4f86-a8e9-40ebb2a79686 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.749005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.749666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.749955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.750234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.750938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.753160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.812573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1122/2257] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:02.816596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.845730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37355b1-9a62-4929-8624-937ca8067e5e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.918871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.920046 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.920589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.921118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:02.922049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:02.925118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:02.956982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1136/2258] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:02 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:02.962137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:02.984521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f3eb-1022-4e6c-8c95-97caac6a3a6b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:02.995753 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:02.997677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:02.998318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:02.998874 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.001074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.006263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.043817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1123/2259] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:03.047977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:03.061815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ae983-af87-4e33-a4fd-0523ff12ac06 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:03.067940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:03.069022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.069574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.070240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] PATH_INFO: `/v3/projects/62b0ff0186804326a1055dde6cd9277e/users/85cfa779732747a28dafa5af18466d60/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.099395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b0ff0186804326a1055dde6cd9277e, user_id=85cfa779732747a28dafa5af18466d60, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.103083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.125368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1137/2260] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:03 2022] PUT /identity/v3/projects/62b0ff0186804326a1055dde6cd9277e/users/85cfa779732747a28dafa5af18466d60/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:03.127306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:03.150215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65b0eb-ca9c-4bca-bfc1-6d8db1938048 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:03.227392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:03.229088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.229578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.230672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.231892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.234058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09689d2b-1199-48a8-b2f4-00753689bf67 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.268474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1124/2261] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:03.271584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:03.291092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a92c7-8c84-48d4-a32f-76a6c7efecaf admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:03.301425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:03.302713 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.303076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.303425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] PATH_INFO: `/v3/projects/62b0ff0186804326a1055dde6cd9277e/users/85cfa779732747a28dafa5af18466d60/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.305866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b0ff0186804326a1055dde6cd9277e, user_id=85cfa779732747a28dafa5af18466d60, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.310096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.337025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1138/2262] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:03 2022] PUT /identity/v3/projects/62b0ff0186804326a1055dde6cd9277e/users/85cfa779732747a28dafa5af18466d60/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:03.339353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.339353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.339353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.398510 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] MFA Rules not processed for user `85cfa779732747a28dafa5af18466d60`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:03.404042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:03.540621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1125/2263] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:03.541235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:03.543302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:03.644458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2edfdd-d16d-43b8-b1cb-c636ae23d1c4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:03.652383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:03.653027 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.653370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.653714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.665600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.668091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40ccf7-40b2-458e-ab7e-bf9c4b8f272a service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.682354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1139/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:50:03.798351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:03.810778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ca0d-6f29-4016-9b23-cab33cb6f048 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:03.814857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:03.815656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:03.816008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:03.817702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:03.889419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:03.891402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:03.902236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1126/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:10.777891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:10.778460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:10.778460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:10.813746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:10.815330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:10.919287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1140/2266] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:10.957704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:10.961056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:11.150914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4588a-4bea-4240-b0ee-d0f81a9d0467 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:11.156479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:11.157692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:11.157976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:11.158416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:11.173157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:11.174799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea408b74-084f-46b9-93d3-a3141c8b0602 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:11.185369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1127/2267] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:11.490074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:11.491808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:11.639790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ee63-f3d8-4123-a135-97726633e967 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:11.654742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:11.655641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:11.655920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:11.656198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] PATH_INFO: `/v3/users/8da65bee4c8c455d8dd8846778d7821a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:11.663264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da65bee4c8c455d8dd8846778d7821a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:11.666606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:11.767124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da65bee4c8c455d8dd8846778d7821a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:11.797654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da65bee4c8c455d8dd8846778d7821a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:11.799474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da65bee4c8c455d8dd8846778d7821a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:11.800545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da65bee4c8c455d8dd8846778d7821a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:11.810067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da65bee4c8c455d8dd8846778d7821a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:11.841746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1141/2268] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:11 2022] DELETE /identity/v3/users/8da65bee4c8c455d8dd8846778d7821a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:11.846470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611a21-4909-414f-8276-637cea12753b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:11.846763 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611a21-4909-414f-8276-637cea12753b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:11.847044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62611a21-4909-414f-8276-637cea12753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:11.867498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-62611a21-4909-414f-8276-637cea12753b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:11.868752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-62611a21-4909-414f-8276-637cea12753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:11.956416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1128/2269] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:11.970182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:11.972204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:12.071964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eeca43-08d2-411f-b018-583b99f5a2d5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:12.087829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:12.088788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:12.089247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:12.089670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:12.102448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:12.103916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:12.122597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1142/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:12.227764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:12.228239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:12.228588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:12.265725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:12.267307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:12.391829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1129/2271] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:12.414672 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:12.416437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:12.568857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64924d22-00c7-4325-9c15-f45a29fdc7f8 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:12.577647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:12.581853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:12.583438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:12.583972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:12.597041 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:12.599207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:12.599519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:12.602368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabedf0d-1d75-450f-b713-34d2992b6f07 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:12.618618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87473d2-5ef8-4a96-b3af-7dd43638215b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:12.625558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:12.627346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:12.627780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:12.628236 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] PATH_INFO: `/v3/projects/840127a9fe414efda3cc5fa6142256bd` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:12.629729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1143/2272] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:12.632561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840127a9fe414efda3cc5fa6142256bd)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:12.637018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:12.719607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840127a9fe414efda3cc5fa6142256bd', 'request_id': 'req-706203ec-0feb-40c9-b7cd-1daf494a9394'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:12.734592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840127a9fe414efda3cc5fa6142256bd', 'request_id': 'req-706203ec-0feb-40c9-b7cd-1daf494a9394'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:12.741089 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840127a9fe414efda3cc5fa6142256bd', 'request_id': 'req-706203ec-0feb-40c9-b7cd-1daf494a9394'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:12.760099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] The token cache is being invalidate because project 840127a9fe414efda3cc5fa6142256bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:12.761254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:12.762628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-706203ec-0feb-40c9-b7cd-1daf494a9394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:12.768907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1130/2273] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:12 2022] DELETE /identity/v3/projects/840127a9fe414efda3cc5fa6142256bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:12.771265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:12.774839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:12.775332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:12.822579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:12.824649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.013373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1144/2274] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:13.023380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.023380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.023380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.069443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:13.070850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.084875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1131/2275] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:13.089395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.119533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4307de-a048-4c32-aae9-28e3021f98d3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.150860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.151579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.151804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.152043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.154075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:13.154621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.156736 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89401630-39ed-475b-8782-43206a4de2d4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.157703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.160017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.175014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1145/2276] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:13.177082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.177539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.177985 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.193817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59983a8-f5ea-41ac-9a40-dc0a48fae8ce None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.201819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:13.202140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.203192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.203484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.203661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.204028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] PATH_INFO: `/v3/users/3588232b4e184c929f27a67830b1992e` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.205406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3588232b4e184c929f27a67830b1992e)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.208574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.267766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3588232b4e184c929f27a67830b1992e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:13.282573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3588232b4e184c929f27a67830b1992e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:13.283624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3588232b4e184c929f27a67830b1992e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:13.284504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3588232b4e184c929f27a67830b1992e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:13.304189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-f067df6e-0567-4b52-aebd-f8a9e417022f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3588232b4e184c929f27a67830b1992e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:13.343403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1146/2277] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:13.344254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.345779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.356937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1132/2278] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:13 2022] DELETE /identity/v3/users/3588232b4e184c929f27a67830b1992e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:13.370881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b05d9-53e2-434d-a23a-9fbc647a9be2 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.372061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.372382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.376028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.406572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:13.407983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.492025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.492837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.493235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.493587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.494411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.496966 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.511237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1133/2279] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:13.514384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.515995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.547095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1147/2280] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:13 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:13.548008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.550038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:13.613837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af44d8e-ced5-44c5-b9c9-8787d93fe032 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.653927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027370-aa6f-4052-b246-93a7c0d3996a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.661435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.662416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.662771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.663174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.701679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.702629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.703068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.703630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.781892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.783409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.796319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1148/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:13.797619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.804950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.806764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.810064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c83228-b028-48c0-82c8-baf37db18fb3 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.820188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.820188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.820188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.820188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.821258 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.822282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1134/2282] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:13.823940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.857123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1149/2283] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:13 2022] POST /identity/v3/users => generated 281 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:13.861573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.875826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c250cb-5a3c-425d-9fec-110da7c21ba9 service swift] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.886438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.890022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.890606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.891100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.892848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.897656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.913494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1135/2284] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:13.917489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:13.933809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d26d3-f1d7-4970-aa6e-ab7670a37e0c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:13.940498 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:13.941861 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:13.942676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:13.942676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:13.943892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:13.946174 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e389-0686-4290-8a38-bfee602c987a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:13.980326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1150/2285] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:13.984797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:14.012118 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9e51-07ab-41c1-9ab7-e67cdf0ad9ad admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:14.037620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:14.039423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:14.040412 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:14.040764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] PATH_INFO: `/v3/projects/54d0825dc4fd4ee9aec56e66d5dc0f57/users/b7ff83b6be7c4873aded5cecd4a6666a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:14.069018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d0825dc4fd4ee9aec56e66d5dc0f57, user_id=b7ff83b6be7c4873aded5cecd4a6666a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:14.071868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:14.095037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1136/2286] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:13 2022] PUT /identity/v3/projects/54d0825dc4fd4ee9aec56e66d5dc0f57/users/b7ff83b6be7c4873aded5cecd4a6666a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:14.107014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:14.107330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:14.107597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:14.148681 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] MFA Rules not processed for user `b7ff83b6be7c4873aded5cecd4a6666a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:14.163292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.217850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:14.219849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.420643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1151/2287] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:14.459539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe363-b4aa-4c11-8387-8b669b4e22ff admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:14.481243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:14.483891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.487943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:14.489427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:14.489714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:14.489979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] PATH_INFO: `/v3/projects/5841273087614d058a909829b536e122` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:14.492300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5841273087614d058a909829b536e122)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:14.504722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:14.634040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5841273087614d058a909829b536e122', 'request_id': 'req-d471f799-ef68-4865-96e4-ffc39beb7548'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:14.649309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66408ff-4817-4617-9d86-5ffb31fc4996 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:14.653421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5841273087614d058a909829b536e122', 'request_id': 'req-d471f799-ef68-4865-96e4-ffc39beb7548'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:14.672403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5841273087614d058a909829b536e122', 'request_id': 'req-d471f799-ef68-4865-96e4-ffc39beb7548'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:14.692436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] The token cache is being invalidate because project 5841273087614d058a909829b536e122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:14.693090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:14.694430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d471f799-ef68-4865-96e4-ffc39beb7548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:14.697134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1137/2288] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:14 2022] DELETE /identity/v3/projects/5841273087614d058a909829b536e122 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:14.702396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:14.703500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:14.703937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:14.731647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:14.732405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:14.732762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:14.733288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:14.735678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.740267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:14.741898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.843407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:14.847281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:14.868689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1138/2289] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:14.870027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:14.878114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1152/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:14.900682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:14.902277 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:14.906390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.048788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996336b-c3f5-4652-8b1d-adb1511da658 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.064586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.066976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.067428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.067870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] PATH_INFO: `/v3/users/b7ff83b6be7c4873aded5cecd4a6666a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.069970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ff83b6be7c4873aded5cecd4a6666a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.072310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:15.103452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd4a08-3fd5-4104-8fe7-e421f42a6593 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.116780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.118384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.119425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.119720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] PATH_INFO: `/v3/users/85cfa779732747a28dafa5af18466d60` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.121872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cfa779732747a28dafa5af18466d60)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.124862 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:15.153721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ff83b6be7c4873aded5cecd4a6666a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.172950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ff83b6be7c4873aded5cecd4a6666a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.174198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ff83b6be7c4873aded5cecd4a6666a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.175315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ff83b6be7c4873aded5cecd4a6666a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.183644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ff83b6be7c4873aded5cecd4a6666a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.186922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cfa779732747a28dafa5af18466d60'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.199575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1153/2291] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:14 2022] DELETE /identity/v3/users/b7ff83b6be7c4873aded5cecd4a6666a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:15.200799 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:15.201455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cfa779732747a28dafa5af18466d60'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.202624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cfa779732747a28dafa5af18466d60'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.203111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.203598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cfa779732747a28dafa5af18466d60'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.214342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cfa779732747a28dafa5af18466d60'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.236367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1139/2292] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:14 2022] DELETE /identity/v3/users/85cfa779732747a28dafa5af18466d60 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:15.237255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:15.238785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.295469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415118d-4e7e-4a2f-947d-62e8d57040ea admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.322009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a1618-18fb-447f-a0ed-800e2a402e21 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.327671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.328838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.329253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.329746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] PATH_INFO: `/v3/users/e770bdbdd26a4e5499cc3695fcd1f42a` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.331930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e770bdbdd26a4e5499cc3695fcd1f42a)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.335252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:15.409305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.411793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.412342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.413015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.416541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.425506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e770bdbdd26a4e5499cc3695fcd1f42a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.453241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e770bdbdd26a4e5499cc3695fcd1f42a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.455701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e770bdbdd26a4e5499cc3695fcd1f42a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.456380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e770bdbdd26a4e5499cc3695fcd1f42a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.473427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dc339301-93ad-45c1-ae10-3ba96653261a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e770bdbdd26a4e5499cc3695fcd1f42a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:15.512636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1140/2293] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:15 2022] DELETE /identity/v3/users/e770bdbdd26a4e5499cc3695fcd1f42a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:15.513588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.513887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.514167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.531600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.534604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447bd7c-f3f1-49b7-8c70-f52e6ed282f1 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:15.547151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1154/2294] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:15.552151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.552694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.553108 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.568568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:15.577913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.599821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:15.603149 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.748067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1141/2295] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:15.761293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1155/2296] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:15.762013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:15.767329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.776263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:15.782937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.875275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5addc-0da3-4c7c-9fd1-eb4991da3e39 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.886451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.887317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.887667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.888009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.900011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.902288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:15.916464 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1142/2297] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:15.917800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:15.922613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:15.948615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0e222-b1f5-4c69-9cf5-f8ac3bbbcdb4 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:15.979202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:15.980597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:15.984981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:15.987026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] PATH_INFO: `/v3/projects/62b0ff0186804326a1055dde6cd9277e` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:15.990647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b0ff0186804326a1055dde6cd9277e)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:15.994416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:16.009650 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec70211-ec64-4fa4-9d93-078b7fc1fc3e None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:16.032257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:16.032990 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.033300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.033611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.065124 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:16.067350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f2fe2-046b-4c03-b35a-c137f995eda0 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:16.139435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1156/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:16.212449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b0ff0186804326a1055dde6cd9277e', 'request_id': 'req-fbff2172-455f-458d-ab32-ae4e593e52da'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.224554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b0ff0186804326a1055dde6cd9277e', 'request_id': 'req-fbff2172-455f-458d-ab32-ae4e593e52da'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.279723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b0ff0186804326a1055dde6cd9277e', 'request_id': 'req-fbff2172-455f-458d-ab32-ae4e593e52da'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.319472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] The token cache is being invalidate because project 62b0ff0186804326a1055dde6cd9277e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:16.319817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.320775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fbff2172-455f-458d-ab32-ae4e593e52da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.322872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1143/2299] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:15 2022] DELETE /identity/v3/projects/62b0ff0186804326a1055dde6cd9277e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:16.329589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.329941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.330288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.372991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:16.374728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:16.500187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1157/2300] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:16.513282 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40493-ed71-499c-a887-090bf013529b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.513683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40493-ed71-499c-a887-090bf013529b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.514101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f40493-ed71-499c-a887-090bf013529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.544859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d2f40493-ed71-499c-a887-090bf013529b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:16.546514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d2f40493-ed71-499c-a887-090bf013529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:16.561410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1144/2301] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:16.565981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:16.585530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d847b40-1367-4086-810d-418f678c0bcc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:16.613755 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:16.614598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.614974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.615320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.626702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:16.627170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:16.629935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:16.666489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f40493-ed71-499c-a887-090bf013529b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:16.667935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d2f40493-ed71-499c-a887-090bf013529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:16.670164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1158/2302] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:16.675100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:16.687295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3ce16-219c-47a3-a099-d71f04ecd814 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:16.696765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:16.697696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.697993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.698274 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.698977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:16.701160 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:16.730434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f40493-ed71-499c-a887-090bf013529b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:16.755576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1159/2303] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:16 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:16.757671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:16.759485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:16.760925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.762494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.763262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] PATH_INFO: `/v3/projects/54d0825dc4fd4ee9aec56e66d5dc0f57` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.768397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d0825dc4fd4ee9aec56e66d5dc0f57)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:16.772127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:16.893721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d0825dc4fd4ee9aec56e66d5dc0f57', 'request_id': 'req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.903176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1262e-6693-41d3-b981-e5cddfeb9219 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:16.916172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d0825dc4fd4ee9aec56e66d5dc0f57', 'request_id': 'req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.930139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d0825dc4fd4ee9aec56e66d5dc0f57', 'request_id': 'req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.949768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] The token cache is being invalidate because project 54d0825dc4fd4ee9aec56e66d5dc0f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:16.950145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.950761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:16.953450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1145/2304] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:16 2022] DELETE /identity/v3/projects/54d0825dc4fd4ee9aec56e66d5dc0f57 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:16.954449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:16.955879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:16.981674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:16.983119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:16.983880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:16.984458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:16.985495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:16.988076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b217e0c-49a8-4d90-ae95-4c1e6671888d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.028210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1160/2305] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:16 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:17.029890 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.030269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.030789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.056856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:17.059163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.102268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1161/2306] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:17.102268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.104602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef457c3-74b4-46d1-81e9-56d49fb94eb7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.105684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.115337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.116741 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.117242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.117733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] PATH_INFO: `/v3/projects/c8054f104e3b4786b875d9ba5852c014` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.119290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8054f104e3b4786b875d9ba5852c014)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.122160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.127937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce526d1-f891-405a-9cc9-d7b97221ce1c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.134653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.135398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.135912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.136233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.137899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.140617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34285d1-155f-4fc5-a598-ddf6b13c9d3c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.160489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1162/2307] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:17.163250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7105e5-2773-4ba1-9cc0-448796b7f42d None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.163581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7105e5-2773-4ba1-9cc0-448796b7f42d None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.163818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7105e5-2773-4ba1-9cc0-448796b7f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.201230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-6a7105e5-2773-4ba1-9cc0-448796b7f42d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:17.202692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6a7105e5-2773-4ba1-9cc0-448796b7f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.232991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8054f104e3b4786b875d9ba5852c014', 'request_id': 'req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:17.253576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8054f104e3b4786b875d9ba5852c014', 'request_id': 'req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:17.291642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8054f104e3b4786b875d9ba5852c014', 'request_id': 'req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:17.318258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] The token cache is being invalidate because project c8054f104e3b4786b875d9ba5852c014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:17.318634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:17.320488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:17.323181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1146/2308] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:16 2022] DELETE /identity/v3/projects/c8054f104e3b4786b875d9ba5852c014 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:17.327959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.329185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.353761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1163/2309] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:17.361138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c03e2c-8df5-4583-bac7-66e5c89ecfb0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.361628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.362113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.362797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.368376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.369648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.369990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.370333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.375603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.375603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.392864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1147/2310] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:17.392864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.406375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2770f-411c-4d3d-9cd4-c78a942a2e2d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.415945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.417076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.417585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.418197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.419388 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:17.420080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.422636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.438457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:17.441461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.443265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1148/2311] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:17.447971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.478790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1164/2312] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:17.479790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.486901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6222a5-098d-4f0f-b0e3-4b2b924cebc0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.494293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.496295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.496585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.499020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] PATH_INFO: `/v3/projects/80df069b6c2a4f5282d559174c512b32/users/87d5fdfd5f474e5bb29375ebacb6e1e3/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.515655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f185d4-ff82-4404-9260-71b2f128a583 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.527272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.528860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.529401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80df069b6c2a4f5282d559174c512b32, user_id=87d5fdfd5f474e5bb29375ebacb6e1e3, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.536052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c1602-8a36-44d3-a68e-f920daa909a5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.536659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.537264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.538450 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.541397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d5900-1274-41b8-bc8e-b358708b7825 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.565920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1149/2313] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:17 2022] PUT /identity/v3/projects/80df069b6c2a4f5282d559174c512b32/users/87d5fdfd5f474e5bb29375ebacb6e1e3/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:17.569315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.569602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.571008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.606926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1165/2314] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:17.613811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.614494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.621427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.633392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:17.634978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.707963 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] MFA Rules not processed for user `87d5fdfd5f474e5bb29375ebacb6e1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:17.709429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:17.862132 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1150/2315] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:17.862132 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.873050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1166/2316] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:17.874199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.894979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5390d-a1fb-44b9-8660-75dba8ebd268 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.900374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea24732-2573-44cb-bd67-7c9eee70265a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.902440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.903728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.904637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.904921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.906408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:17.906877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.907476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.908258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.908978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.908978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.909223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.910499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.912866 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.924184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1167/2317] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:17.929920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.942324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5addce-6d80-42d7-8bdb-6030a5557d82 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.949949 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.950591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.950921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.951199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.951942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.953460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1151/2318] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:17.955392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:17.960298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:17.979955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba1c2-8679-4fed-ab30-37be1609e93c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:17.987218 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:17.988158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:17.988919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:17.989672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:17.990957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:17.998547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.013889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1168/2319] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:18.016112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.045713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1152/2320] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:17 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:18.045713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.126085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcde1f-0569-4214-8289-6bc7a6492bd7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.161024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296be0e4-d413-4ca0-82e6-9e65181c9069 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.166362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.167045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.167331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.167600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.168339 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.170281 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.193292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1153/2321] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:18 2022] POST /identity/v3/users => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:18.197305 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.208116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464bd5-64c5-4d77-aea2-1bc31e4c4782 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.213359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.214056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.214360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.214639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.215025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.217855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.217855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.220567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.221234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.221783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.223232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.226850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.239487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1154/2322] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:18 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:18.239487 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.248342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1169/2323] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.249762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.251357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d36c8-b291-4f57-a31a-49813f60b342 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.258642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.259390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.259662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.259936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.260868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.262551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.271307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fb951-2262-4e4d-9e46-58b4dbb9bdfd admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.278579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.279872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.280462 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.280919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.281900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.283586 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.288303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1155/2324] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.288303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.304816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91e7f-6b8f-4325-a89e-26ce5bb51378 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.309470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1170/2325] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.309470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.317847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.319220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.319837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.320399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.321175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c640-b729-41c8-b77b-cb4d9a89d38b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.321893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.324911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.326955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.327845 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.328128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.328438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] PATH_INFO: `/v3/projects/14780c00aea04caea9cfffb68dd5502a/users/177dc184041c40b4b3c9d569cf0d7ef6/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.350589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1156/2326] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.351836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.359103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14780c00aea04caea9cfffb68dd5502a, user_id=177dc184041c40b4b3c9d569cf0d7ef6, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.363267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.372962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc52ac-8283-480d-a4a6-348db485bbf8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.382121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.382920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.383979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.384460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.385368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.387123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.388356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1171/2327] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:18 2022] PUT /identity/v3/projects/14780c00aea04caea9cfffb68dd5502a/users/177dc184041c40b4b3c9d569cf0d7ef6/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:18.390383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.404522 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1157/2328] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.405907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.430155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bc61-97f2-49bb-ac3e-33f79fef6e03 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.497880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1e71-8fc3-43cf-b53f-3ae08a7d4bd0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.509187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.511399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.511852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.512418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] PATH_INFO: `/v3/projects/65f82afb2b574d21ba59a77ce4f80a6a/users/ff1e2c04053944feaf948a37f9668ebd/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.515802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.516664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.517071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.517455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.518502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.521287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.540303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1158/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:18.540671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.560445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983461e-ee03-4242-81fa-bec838a72312 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.569812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f82afb2b574d21ba59a77ce4f80a6a, user_id=ff1e2c04053944feaf948a37f9668ebd, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.570935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.575376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.575376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.575376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] PATH_INFO: `/v3/projects/c286733ad0074e32bcc771e90a3ad8a7/users/d5176d697d9a4d569709559147c7f334/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.575788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.591978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1172/2330] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:18 2022] PUT /identity/v3/projects/65f82afb2b574d21ba59a77ce4f80a6a/users/ff1e2c04053944feaf948a37f9668ebd/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:18.592241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.603425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c286733ad0074e32bcc771e90a3ad8a7, user_id=d5176d697d9a4d569709559147c7f334, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.607045 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6c2c4-897a-4a34-8f2c-263caf215369 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.624849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1159/2331] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:18 2022] PUT /identity/v3/projects/c286733ad0074e32bcc771e90a3ad8a7/users/d5176d697d9a4d569709559147c7f334/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:18.635103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20af1-2dee-4565-b6f9-c2adab0c9007 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.635406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20af1-2dee-4565-b6f9-c2adab0c9007 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.635579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f20af1-2dee-4565-b6f9-c2adab0c9007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.676626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c1f20af1-2dee-4565-b6f9-c2adab0c9007 None None] MFA Rules not processed for user `ff1e2c04053944feaf948a37f9668ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:18.678211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c1f20af1-2dee-4565-b6f9-c2adab0c9007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:18.679275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd80a9-df15-4502-81aa-076960b0794d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:18.757611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:18.758653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.759410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.759779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] PATH_INFO: `/v3/projects/14780c00aea04caea9cfffb68dd5502a/users/177dc184041c40b4b3c9d569cf0d7ef6/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.763191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14780c00aea04caea9cfffb68dd5502a, user_id=177dc184041c40b4b3c9d569cf0d7ef6, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:18.767349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af5315-2c3e-4931-a500-ad54c1d35083 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:18.781674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1173/2332] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:18 2022] PUT /identity/v3/projects/14780c00aea04caea9cfffb68dd5502a/users/177dc184041c40b4b3c9d569cf0d7ef6/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:18.797502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.797869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.798219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.817665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1160/2333] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:18.833115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:18.833684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:18.834125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:18.836437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] MFA Rules not processed for user `d5176d697d9a4d569709559147c7f334`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:18.837734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:18.870235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] MFA Rules not processed for user `177dc184041c40b4b3c9d569cf0d7ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:18.871576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:18.961793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1174/2334] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:18.963902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:18.969189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.011859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1161/2335] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:19.016717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.018233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.075591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21f904-3e19-4ccb-b8eb-f27d0ce96a15 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.081199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.093993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.094433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.095111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] PATH_INFO: `/v3/users/8de59690354e4f00b10847b64c1166ab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.097937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de59690354e4f00b10847b64c1166ab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:19.103280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:19.131548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188548b-586b-47af-bb72-6c5156960b78 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.141942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.142509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.142792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.143061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.213409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de59690354e4f00b10847b64c1166ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.215265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:19.221810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:19.234070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1162/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:19.234933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.236524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.239350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de59690354e4f00b10847b64c1166ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.240347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de59690354e4f00b10847b64c1166ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.241298 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de59690354e4f00b10847b64c1166ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.251748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9b7a5985-f482-492a-8a9d-51b469dfb850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de59690354e4f00b10847b64c1166ab'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.263605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5c933-fa20-49ae-8f6b-12892d9c98f1 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.268382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1175/2337] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:18 2022] DELETE /identity/v3/users/8de59690354e4f00b10847b64c1166ab => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:19.274084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.274382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.274661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.274775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.275406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.275694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.275968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.278018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.292124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:19.294509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:19.318962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1163/2338] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:19.324561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:19.327090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.335091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.336553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.349501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9064f4-9f16-478c-a9c3-e90224088f29 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.445817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.446692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.446972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.447250 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.452174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.461899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1176/2339] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:19.465342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.477183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.500683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343e20-4ea9-4b01-b4ac-e40c53d4a437 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.507188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.508070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.508431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.508706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] PATH_INFO: `/v3/users/d5176d697d9a4d569709559147c7f334` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.510196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5176d697d9a4d569709559147c7f334)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:19.513182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:19.625500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5176d697d9a4d569709559147c7f334'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.643215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:19.647334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:19.663696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5176d697d9a4d569709559147c7f334'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.667331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1164/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:19.668229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.671214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.685216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5176d697d9a4d569709559147c7f334'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.690358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5176d697d9a4d569709559147c7f334'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.717589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7e938c89-eb37-47a1-96b7-8769d85d8649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5176d697d9a4d569709559147c7f334'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:19.748105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1177/2341] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:19 2022] DELETE /identity/v3/users/d5176d697d9a4d569709559147c7f334 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:19.757218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.757589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.757804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.794663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:19.796306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.821039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28747745-0312-47b1-8c39-9a29553241d1 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:19.898342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1178/2342] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:19.898342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:19.899150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:19.980863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:19.981528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:19.981814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:19.982177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:19.990160 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.007234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86939da8-0633-42b4-b3d5-f6ffc05c71d0 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:20.011049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:20.012498 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.012790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.013248 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.015488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.015626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.017190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.043408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1165/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:20.045052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:20.047390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.073460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9eff2-ef31-4ae0-868e-d3b2589f0dea service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:20.078382 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:20.079054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.079387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.079671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.092314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.094120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.107571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1166/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:20.110992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.112563 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.127491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1179/2345] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:20.549245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:20.551978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.606962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b98c-42fc-4bec-b50c-f498bf8bca92 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:20.626178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:20.627697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.628202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.634419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] PATH_INFO: `/v3/users/87d5fdfd5f474e5bb29375ebacb6e1e3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.636668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d5fdfd5f474e5bb29375ebacb6e1e3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.639040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.669021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:20.682530 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.741314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c784-14df-4360-b853-26ea4008af60 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:20.751432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:20.752809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.754704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.757143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] PATH_INFO: `/v3/projects/9cba4b165ecb44ef8c7018958198eb36` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.760558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cba4b165ecb44ef8c7018958198eb36)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:20.766112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:20.774795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d5fdfd5f474e5bb29375ebacb6e1e3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.803436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d5fdfd5f474e5bb29375ebacb6e1e3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.804791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d5fdfd5f474e5bb29375ebacb6e1e3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.805626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d5fdfd5f474e5bb29375ebacb6e1e3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.834992 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-fa4f67c2-cd94-45c6-a881-2fd18d47cd1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d5fdfd5f474e5bb29375ebacb6e1e3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.862203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1167/2346] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:20 2022] DELETE /identity/v3/users/87d5fdfd5f474e5bb29375ebacb6e1e3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:20.869068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918fe8-9f9b-4642-946c-5d029f4a5fa1 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:20.869368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918fe8-9f9b-4642-946c-5d029f4a5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:20.869651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918fe8-9f9b-4642-946c-5d029f4a5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:20.871226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cba4b165ecb44ef8c7018958198eb36', 'request_id': 'req-efa11dd3-aefd-4acf-8e6d-d85446545851'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.899532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cba4b165ecb44ef8c7018958198eb36', 'request_id': 'req-efa11dd3-aefd-4acf-8e6d-d85446545851'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.914366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bb918fe8-9f9b-4642-946c-5d029f4a5fa1 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:20.916001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bb918fe8-9f9b-4642-946c-5d029f4a5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:20.918724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cba4b165ecb44ef8c7018958198eb36', 'request_id': 'req-efa11dd3-aefd-4acf-8e6d-d85446545851'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.944526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] The token cache is being invalidate because project 9cba4b165ecb44ef8c7018958198eb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:20.945138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.947186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:20.968692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1180/2347] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:20 2022] DELETE /identity/v3/projects/9cba4b165ecb44ef8c7018958198eb36 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:20.969997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:20.973543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:21.103273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1168/2348] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:21.103273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.103273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.103273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.144882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa11dd3-aefd-4acf-8e6d-d85446545851 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.149946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:21.152815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:21.160519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.161531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.161723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.161936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] PATH_INFO: `/v3/projects/c286733ad0074e32bcc771e90a3ad8a7` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.163848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c286733ad0074e32bcc771e90a3ad8a7)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.166073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.187301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1169/2349] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:21.187301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:21.194737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:21.287567 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf4cab-495e-463d-a86f-75e9b0c9fb84 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.293117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c286733ad0074e32bcc771e90a3ad8a7', 'request_id': 'req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:21.306044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c286733ad0074e32bcc771e90a3ad8a7', 'request_id': 'req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:21.327631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c286733ad0074e32bcc771e90a3ad8a7', 'request_id': 'req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:21.375381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.376057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.376364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.376647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.379028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] The token cache is being invalidate because project c286733ad0074e32bcc771e90a3ad8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:21.382311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:21.385005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ffb862d9-e77e-4cf7-aec3-a32a72e3c918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:21.389926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1181/2350] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:20 2022] DELETE /identity/v3/projects/c286733ad0074e32bcc771e90a3ad8a7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:21.407677 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.407983 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.408251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.471878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:21.475179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:21.562963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.570569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.600352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1170/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:21.644497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1182/2352] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:21.649640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:21.651813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:21.673946 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba7bd-5535-4d41-8155-e47aa63b11c1 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.682632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.683732 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.684083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.684495 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.685301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:21.685711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.687446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.703338 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1171/2353] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:50:21.708882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:21.720109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5da98-f16b-4afa-8704-711ecc181df8 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.725705 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.726379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.726659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.726933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.727631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.729820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.767032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1183/2354] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:21 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:21.767537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:21.789288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d5293-d60e-47a9-955a-4ee85eb5ad3b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.900735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.901743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.902462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.902998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.903916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.913820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.947722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1172/2355] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:21 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:21.952063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:21.968994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944e76b-5068-4d78-9789-8aa6718230cb admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:21.976964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:21.977480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:21.977761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:21.978094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:21.979112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:21.980763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:21.994661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1184/2356] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:21.998788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:22.011952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66c36c-a2a3-4eda-8358-82fa9af6c95d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:22.018304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:22.019375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.020026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.020562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.022617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:22.024608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:22.047661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1173/2357] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:50:22.056447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:22.070800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:22.072638 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:22.072999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c36289-e2fa-4cb6-a711-9f766e6707ab admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:22.078463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:22.079455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.079807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.080159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] PATH_INFO: `/v3/projects/ea67afdf22fd4b41ac5f34bc29f3b7b8/users/dd61c2b29a8e448e9d18ac20959f3e1d/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.109709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9b185-e77e-41b9-b719-f7f449fecc1d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:22.116900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:22.118151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.118634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.119114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] PATH_INFO: `/v3/projects/80df069b6c2a4f5282d559174c512b32` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.120705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80df069b6c2a4f5282d559174c512b32)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:22.121991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea67afdf22fd4b41ac5f34bc29f3b7b8, user_id=dd61c2b29a8e448e9d18ac20959f3e1d, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:22.124071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:22.125717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176f43-1a81-4e95-9968-2e9654e9eaeb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:22.164235 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1185/2358] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:22 2022] PUT /identity/v3/projects/ea67afdf22fd4b41ac5f34bc29f3b7b8/users/dd61c2b29a8e448e9d18ac20959f3e1d/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:22.170089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.170394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.170668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.194440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:22.195778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:22.236406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80df069b6c2a4f5282d559174c512b32', 'request_id': 'req-293c5459-d2bd-45e0-a1db-2ae108334ba1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.242812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80df069b6c2a4f5282d559174c512b32', 'request_id': 'req-293c5459-d2bd-45e0-a1db-2ae108334ba1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.257873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80df069b6c2a4f5282d559174c512b32', 'request_id': 'req-293c5459-d2bd-45e0-a1db-2ae108334ba1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.271325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1186/2359] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:22.286167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:22.294038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:22.302861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] The token cache is being invalidate because project 80df069b6c2a4f5282d559174c512b32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:22.304633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.308621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.313797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1174/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:22 2022] DELETE /identity/v3/projects/80df069b6c2a4f5282d559174c512b32 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:22.318609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:22.320698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:22.389324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a389e58-ef06-4189-a71a-8b11ccf039da None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:22.419088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c5459-d2bd-45e0-a1db-2ae108334ba1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:22.426254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:22.427477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.427857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.428455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] PATH_INFO: `/v3/users/177dc184041c40b4b3c9d569cf0d7ef6` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.430113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177dc184041c40b4b3c9d569cf0d7ef6)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:22.433343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:22.484855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:22.495981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:22.495981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:22.495981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:22.496393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:22.526757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:22.528222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:22.543825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177dc184041c40b4b3c9d569cf0d7ef6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.547008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1187/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:22.561082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177dc184041c40b4b3c9d569cf0d7ef6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.562261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177dc184041c40b4b3c9d569cf0d7ef6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.563024 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177dc184041c40b4b3c9d569cf0d7ef6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.580631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-cf4630df-2244-4d13-97fa-802c98324a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177dc184041c40b4b3c9d569cf0d7ef6'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:22.602582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1175/2362] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:22 2022] DELETE /identity/v3/users/177dc184041c40b4b3c9d569cf0d7ef6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:23.446440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:23.463294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfec88a-26d6-45e6-8296-a3522b676f41 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:23.553857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:23.554597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:23.554976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:23.555345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] PATH_INFO: `/v3/projects/14780c00aea04caea9cfffb68dd5502a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:23.559063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14780c00aea04caea9cfffb68dd5502a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:23.561078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:23.626228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14780c00aea04caea9cfffb68dd5502a', 'request_id': 'req-03eadd13-44fa-4faa-b169-071b67b08704'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:23.633970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14780c00aea04caea9cfffb68dd5502a', 'request_id': 'req-03eadd13-44fa-4faa-b169-071b67b08704'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:23.645352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14780c00aea04caea9cfffb68dd5502a', 'request_id': 'req-03eadd13-44fa-4faa-b169-071b67b08704'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:23.661898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] The token cache is being invalidate because project 14780c00aea04caea9cfffb68dd5502a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:23.662189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:23.662862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:23.664495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1188/2363] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:23 2022] DELETE /identity/v3/projects/14780c00aea04caea9cfffb68dd5502a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:23.808191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7b36-2bcc-4d46-998b-f886036d7e29 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:23.808812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7b36-2bcc-4d46-998b-f886036d7e29 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:23.809049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7b36-2bcc-4d46-998b-f886036d7e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:23.842601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7d0c7b36-2bcc-4d46-998b-f886036d7e29 None None] MFA Rules not processed for user `dd61c2b29a8e448e9d18ac20959f3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:23.843850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7d0c7b36-2bcc-4d46-998b-f886036d7e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:23.922163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1176/2364] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:23.934818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:23.936246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:24.013834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eadd13-44fa-4faa-b169-071b67b08704 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:24.030898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:24.031472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:24.031752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:24.032026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:24.043008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:24.044603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:24.055909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1189/2365] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:25.266153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f6c-8ef9-4920-9ef9-b71f1bd825c2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:25.266692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f6c-8ef9-4920-9ef9-b71f1bd825c2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:25.266692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f6c-8ef9-4920-9ef9-b71f1bd825c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:25.286226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3b0c9f6c-8ef9-4920-9ef9-b71f1bd825c2 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:25.288142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3b0c9f6c-8ef9-4920-9ef9-b71f1bd825c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:25.360645 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1177/2366] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:25.377956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:25.380243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:25.432796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:25.433225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:25.433600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:25.454573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] MFA Rules not processed for user `dd61c2b29a8e448e9d18ac20959f3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:25.456996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:25.464114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09d53-6dcf-4595-8f5c-f1d8f12ac911 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:25.466357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1178/2367] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:25.476122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:25.477340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:25.477340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:25.477664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:25.487820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:25.489695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:25.502044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1190/2368] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:31.089008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:31.094842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:31.185429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb026c-a588-40b1-a898-0ae1674bfa22 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:31.190183 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:31.191225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.191584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.191789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] PATH_INFO: `/v3/users/0cc5e5dfa3bb45c6bf8c4fcfcaadceec` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.193100 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc5e5dfa3bb45c6bf8c4fcfcaadceec)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:31.195071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:31.252611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.271108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.271857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.272513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.280122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6ff3a5c9-80f4-4e66-8585-b1b3165832bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc5e5dfa3bb45c6bf8c4fcfcaadceec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.298796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1179/2369] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:31 2022] DELETE /identity/v3/users/0cc5e5dfa3bb45c6bf8c4fcfcaadceec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:31.485542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:31.500716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5dfd4-784e-4d64-a081-8d4ce83f42bf service swift] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:31.576772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:31.577732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.578089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.578437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] PATH_INFO: `/v3/projects/d968e17fa36f403a923b7b42af28333d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.579753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d968e17fa36f403a923b7b42af28333d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:31.582101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:31.641627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd968e17fa36f403a923b7b42af28333d', 'request_id': 'req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.649602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd968e17fa36f403a923b7b42af28333d', 'request_id': 'req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.658864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd968e17fa36f403a923b7b42af28333d', 'request_id': 'req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.670746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] The token cache is being invalidate because project d968e17fa36f403a923b7b42af28333d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:31.671038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.671741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2fb3dc4d-7f16-458a-9980-0b4252cbaa92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:31.673731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1191/2370] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:31 2022] DELETE /identity/v3/projects/d968e17fa36f403a923b7b42af28333d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:31.679442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.679983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.680506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.700934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:31.702143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:31.766872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1180/2371] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:31.777538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.778053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.778631 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.810208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:31.811464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:31.820765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1192/2372] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:31.825189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:31.837734 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cab8c-4169-4e45-9fbf-d43f15b32e82 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:31.843285 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:31.844081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.844424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.844696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.845438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:31.845750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:31.848015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:31.861950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1181/2373] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:31.867320 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:31.878257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fec62-b7cd-4a1c-ba45-fb84792c2a00 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:31.883406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:31.884128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:31.884637 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:31.884918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:31.885626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:31.887633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:31.922280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1193/2374] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:31 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:31.927473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:31.939815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce5131-5795-4939-a528-5bdaaa87bff3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:32.020789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:32.020789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.020789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.020789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.021170 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:32.022032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:32.048677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1182/2375] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:31 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:50:32.053933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:32.064953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353085e3-5aa5-4b65-b94a-fc14fa057974 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:32.070341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:32.071022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.071310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.071583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.072735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:32.074213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:32.095065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1194/2376] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:32.097501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:32.111697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e683277-fbc0-45c5-81a7-13a7cf1ab35a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:32.121103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:32.121879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.122247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.122619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.123436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:32.125299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f3373-f467-4043-ae0c-335713b483dd admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:32.140328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1183/2377] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:32.142082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:32.154410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da40aef-057d-4ebe-9ef2-3d383f0beba5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:32.159955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:32.161082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.161369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.161643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] PATH_INFO: `/v3/projects/b9272d039f4c4ccc8dbc3a4ed78fbacb/users/b0093e1d194447d5be708c41243819cb/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.182368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9272d039f4c4ccc8dbc3a4ed78fbacb, user_id=b0093e1d194447d5be708c41243819cb, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:32.187211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:32.217294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1195/2378] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:32 2022] PUT /identity/v3/projects/b9272d039f4c4ccc8dbc3a4ed78fbacb/users/b0093e1d194447d5be708c41243819cb/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:32.219943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2de49-2691-4f08-ac33-50f50b64bf1c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.220241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2de49-2691-4f08-ac33-50f50b64bf1c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.220561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2de49-2691-4f08-ac33-50f50b64bf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.254883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-68f2de49-2691-4f08-ac33-50f50b64bf1c None None] MFA Rules not processed for user `b0093e1d194447d5be708c41243819cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:32.258911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-68f2de49-2691-4f08-ac33-50f50b64bf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:32.339276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1184/2379] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:32.351296 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:32.355975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:32.409694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215580c-f1fb-4e60-a5ab-aaac4ab7b01a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.410225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215580c-f1fb-4e60-a5ab-aaac4ab7b01a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.410797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215580c-f1fb-4e60-a5ab-aaac4ab7b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.430080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6215580c-f1fb-4e60-a5ab-aaac4ab7b01a None None] MFA Rules not processed for user `4de0f4da2d2e464fb9501fa58e344bed`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:32.431404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6215580c-f1fb-4e60-a5ab-aaac4ab7b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:32.469439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ca941-122f-45bf-aa66-91c70ed9d60d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:32.474388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:32.475100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:32.475525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:32.475811 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:32.485377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:32.486917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:32.490742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1185/2380] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:50:32.499665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1196/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:40.814747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:40.815370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:40.815370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:40.837181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:40.838559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:40.930924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:40.933331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:40.943368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1186/2382] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:50:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:41.016499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e741e49-1036-4f35-b973-32e7cce4b38c service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:41.022433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:41.023104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:41.023382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:41.023653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:41.034941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:41.036690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b6c7b-6a83-4954-afc9-9a2b377e1214 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:41.046668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1197/2383] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:50:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:50:44.540119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:44.545233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:44.729558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96decfec-6231-49f7-8552-a1c57b97a7f4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:44.741994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:44.744319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:44.744826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:44.745306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] PATH_INFO: `/v3/users/ff1e2c04053944feaf948a37f9668ebd` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:44.747070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1e2c04053944feaf948a37f9668ebd)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:44.749453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:44.882241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1e2c04053944feaf948a37f9668ebd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:44.898440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1e2c04053944feaf948a37f9668ebd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:44.899256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1e2c04053944feaf948a37f9668ebd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:44.900350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1e2c04053944feaf948a37f9668ebd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:44.910022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1e2c04053944feaf948a37f9668ebd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:44.933608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1187/2384] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:44 2022] DELETE /identity/v3/users/ff1e2c04053944feaf948a37f9668ebd => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:44.938585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:44.939122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:44.939122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:44.976455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:44.981767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:45.139113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1198/2385] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:45.175298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:45.177335 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:45.379875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db120a-301b-4e6b-92a5-a2c2d57ed32f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:45.387449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:45.388406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:45.388899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:45.389363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:45.401754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:45.403836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b8ada-f417-43c1-88cc-496d535156be service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:45.419298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1188/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:45.845215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:45.847065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:45.859363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72267075-1318-403e-ba90-9ed458d7d7a3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:45.875113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:45.876014 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:45.876329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:45.876603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] PATH_INFO: `/v3/projects/65f82afb2b574d21ba59a77ce4f80a6a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:45.879379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f82afb2b574d21ba59a77ce4f80a6a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:45.881377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:45.951789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f82afb2b574d21ba59a77ce4f80a6a', 'request_id': 'req-eaf564da-b3f9-40d5-9f6a-c22a1239202c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:45.958300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f82afb2b574d21ba59a77ce4f80a6a', 'request_id': 'req-eaf564da-b3f9-40d5-9f6a-c22a1239202c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:45.973448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f82afb2b574d21ba59a77ce4f80a6a', 'request_id': 'req-eaf564da-b3f9-40d5-9f6a-c22a1239202c'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:45.988210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] The token cache is being invalidate because project 65f82afb2b574d21ba59a77ce4f80a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:45.989093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:45.989937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-eaf564da-b3f9-40d5-9f6a-c22a1239202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:45.991695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1199/2387] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:45 2022] DELETE /identity/v3/projects/65f82afb2b574d21ba59a77ce4f80a6a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:45.997155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:45.998460 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:45.998979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.019038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:46.020244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:46.094228 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1189/2388] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:46.103559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.103881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.104214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.126812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:46.128908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:46.138324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1200/2389] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:46.142724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.153864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495233-a9ee-4360-8f87-18198850a747 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.159853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.160592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.160863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.161137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.161882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:50:46.162189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.163861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.178442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1190/2390] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:50:46.182833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.193439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944f61-b3c3-42e1-acfa-27edd3b0e4b5 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.199178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.199926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.200339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.200701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.201476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.203894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.245369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1201/2391] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:46 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:46.247091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.260782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4429eb5-a7ce-4b13-8d49-94f580caa580 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.354465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.355572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.356087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.356621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.357839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.360621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.417911 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1191/2392] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:46 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:46.422535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.442806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4b2a-de3c-4702-8ca5-be02e2f57f44 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.467183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.468130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.468884 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.469346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.470469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.473436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.489640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1202/2393] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:46.493838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.506906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a981b-bba2-4c9d-860e-b5584b7ad5f7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.511729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.512480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.512808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.513080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.513825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.515499 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace1d0-5265-4857-9127-6a843b914d5f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.527273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1192/2394] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:46.531515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.547290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fe1a0-0717-4a45-9d4b-7d242e3dc8df admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.552850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.553738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.554024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.554303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] PATH_INFO: `/v3/projects/ad2249e85fd741258c91142e19edc714/users/a0aa3cf87a4c4c67a5c8a458f81ef61c/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.575017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2249e85fd741258c91142e19edc714, user_id=a0aa3cf87a4c4c67a5c8a458f81ef61c, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.579372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.594526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1203/2395] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:46 2022] PUT /identity/v3/projects/ad2249e85fd741258c91142e19edc714/users/a0aa3cf87a4c4c67a5c8a458f81ef61c/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:46.601473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.601473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.601473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.624472 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:46.625729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:46.723646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1193/2396] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:46.730559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:46.736407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:46.822295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57380047-c153-48b0-b2e9-449d34ac0f5b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:46.829198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:46.829469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:46.829763 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:46.830231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:46.842889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:46.844387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0d495-9c84-4cf5-824f-56999b0b3fcf service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:46.856955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1204/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:54.447664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:54.452870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:54.503514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4383b9-9041-4333-a0ac-55cbea9e1b4a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:54.518722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:54.519623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:54.525486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:54.525723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] PATH_INFO: `/v3/users/b0093e1d194447d5be708c41243819cb` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:54.528141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0093e1d194447d5be708c41243819cb)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:54.530284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:54.652679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0093e1d194447d5be708c41243819cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:54.686699 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0093e1d194447d5be708c41243819cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:54.687659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0093e1d194447d5be708c41243819cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:54.688410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0093e1d194447d5be708c41243819cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:54.705042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0093e1d194447d5be708c41243819cb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:54.747626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1194/2398] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:50:54 2022] DELETE /identity/v3/users/b0093e1d194447d5be708c41243819cb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:54.752707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b989c-5ac0-4c74-b1ca-bf409ea2da63 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:54.753335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b989c-5ac0-4c74-b1ca-bf409ea2da63 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:54.753433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b989c-5ac0-4c74-b1ca-bf409ea2da63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:54.787101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-849b989c-5ac0-4c74-b1ca-bf409ea2da63 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:54.788550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-849b989c-5ac0-4c74-b1ca-bf409ea2da63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:54.891576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1205/2399] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:54.905432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:54.906902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:55.027432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd703b7-820e-4e3f-a7e8-a819b7d0a4e0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.034439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.035601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.036081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.036593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.050889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.052709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.069142 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1195/2400] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:50:55.174431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.174739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.176003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.225493 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] MFA Rules not processed for user `a0aa3cf87a4c4c67a5c8a458f81ef61c`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:50:55.227305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:55.386555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1206/2401] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:50:55.391462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.393430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:55.419404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76dddb-9007-4f76-bd5f-164210d747cf service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.427253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.427723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.428032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.428672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.429074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.431140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.461523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1196/2402] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:50:55 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:55.466228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.482304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9db1-2bc2-4f7e-afce-bd806f7c7c7f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.499035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.500782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:55.573852 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.574816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.575166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.575667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.576457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.578620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.619465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32efbe-ec07-4e59-889c-ae0b09c477ef admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.628581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1207/2403] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:50:55 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:50:55.633212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.637292 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.644209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.644910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.645308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] PATH_INFO: `/v3/projects/b9272d039f4c4ccc8dbc3a4ed78fbacb` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.646079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a983-9773-45e7-845a-66f62f020bed admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.646821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9272d039f4c4ccc8dbc3a4ed78fbacb)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.649423 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.651368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.652652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.653003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.653687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.654710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.656807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.685024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1208/2404] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:55.689309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.699923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d809-6ce5-4f89-987c-cb2f203fa344 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.705257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.706211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.706435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.706724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] PATH_INFO: `/v3/projects/8882897bb59441a0a22e90b476669850/users/8c044c268bc7487ea33bb1ac21a0f5ce/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.727240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8882897bb59441a0a22e90b476669850, user_id=8c044c268bc7487ea33bb1ac21a0f5ce, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.730089 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.731313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9272d039f4c4ccc8dbc3a4ed78fbacb', 'request_id': 'req-1dee2a91-3e15-4fd1-acbe-a5060631debb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:55.741140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9272d039f4c4ccc8dbc3a4ed78fbacb', 'request_id': 'req-1dee2a91-3e15-4fd1-acbe-a5060631debb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:55.747481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1209/2405] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:55 2022] PUT /identity/v3/projects/8882897bb59441a0a22e90b476669850/users/8c044c268bc7487ea33bb1ac21a0f5ce/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:50:55.753279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.753961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9272d039f4c4ccc8dbc3a4ed78fbacb', 'request_id': 'req-1dee2a91-3e15-4fd1-acbe-a5060631debb'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:55.767408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] The token cache is being invalidate because project b9272d039f4c4ccc8dbc3a4ed78fbacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:50:55.768207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:55.769623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:50:55.771540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1197/2406] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:50:55 2022] DELETE /identity/v3/projects/b9272d039f4c4ccc8dbc3a4ed78fbacb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:55.835871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7245c5-8a30-4885-b158-d46c032a75c9 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.846832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.847646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.847932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.848206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.849029 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.850860 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.864596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1210/2407] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:50:55.867884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:55.870072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:55.972839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2a91-3e15-4fd1-acbe-a5060631debb admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:55.977849 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:55.978764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:55.979049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:55.979326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] PATH_INFO: `/v3/projects/8882897bb59441a0a22e90b476669850/users/8c044c268bc7487ea33bb1ac21a0f5ce/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:55.981825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8882897bb59441a0a22e90b476669850, user_id=8c044c268bc7487ea33bb1ac21a0f5ce, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:55.984617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:55.996101 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1198/2408] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:50:55 2022] PUT /identity/v3/projects/8882897bb59441a0a22e90b476669850/users/8c044c268bc7487ea33bb1ac21a0f5ce/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:50:59.623968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:59.628167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:59.775148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:50:59.780198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:59.920934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d1dd-5857-492a-9056-2422dbc477fa admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:59.928242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:59.928959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:59.929246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:59.929673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:59.933303 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:50:59.946167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85052409-29cb-4012-abcd-c58fdadfebdb admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:50:59.956665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:50:59.959119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a34661-c8a9-4e86-9712-21d60a5fc8b9 service placement] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:50:59.966084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:50:59.966761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:50:59.967824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:50:59.968314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:50:59.992734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:00.005824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1199/2409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:51:00.008694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6bb2c-4388-430f-9d66-61bc4f45f0b2 service placement] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:00.038902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1211/2410] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:51:01.953940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:01.955124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:01.955413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:01.957304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1200/2411] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:51:01.964532 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73221-0bbc-4d3b-a0f2-e5c2eb61d9e7 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:01.965589 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73221-0bbc-4d3b-a0f2-e5c2eb61d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:01.966092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce73221-0bbc-4d3b-a0f2-e5c2eb61d9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.027583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4ce73221-0bbc-4d3b-a0f2-e5c2eb61d9e7 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:02.028955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4ce73221-0bbc-4d3b-a0f2-e5c2eb61d9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:02.134609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1212/2412] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:02.151944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:02.154549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:02.300321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7a45f-ed33-44bf-8243-1428cb003fb1 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:02.307810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:02.308622 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.308979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.309296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.324856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:02.326430 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed5e5b-58d2-4ee7-8358-ec20243bee94 service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:02.340193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1201/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:51:02.426237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.427184 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.427613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.430032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1213/2414] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:51:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:51:02.435961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af692c-e957-485f-a511-446b891fc617 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.436668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af692c-e957-485f-a511-446b891fc617 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.437323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af692c-e957-485f-a511-446b891fc617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.468018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a7af692c-e957-485f-a511-446b891fc617 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:02.469784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a7af692c-e957-485f-a511-446b891fc617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:02.608959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1202/2415] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:02.622974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:02.624964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:02.647694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eacace-b70d-464c-ad14-c6040c129fab None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:02.657808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:02.658841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.659211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.659487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.669954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:02.671953 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1481b27-fd2e-4a24-b081-3ef4e0d2ed24 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:02.706283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1214/2416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:51:02.828084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cc1e-02d2-4454-9817-7a687bddd88f None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.828587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cc1e-02d2-4454-9817-7a687bddd88f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.828684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3cc1e-02d2-4454-9817-7a687bddd88f None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.830941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1203/2417] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:51:02.837877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fcc6-10ab-4552-8061-f79deda1f53f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.839284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fcc6-10ab-4552-8061-f79deda1f53f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.839873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469fcc6-10ab-4552-8061-f79deda1f53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.873964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-7469fcc6-10ab-4552-8061-f79deda1f53f None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:02.875165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7469fcc6-10ab-4552-8061-f79deda1f53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:02.899084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1215/2418] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:02.904845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3cc1e-02d2-4454-9817-7a687bddd88f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:02.957928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3cc1e-02d2-4454-9817-7a687bddd88f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:02.970150 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:02.971603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:02.972219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:02.972590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:02.985001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:02.987452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:03.000366 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1204/2419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:51:03.966022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5908-6c97-4ace-a754-9f0ea279be31 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:03.966558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5908-6c97-4ace-a754-9f0ea279be31 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:03.966648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b5908-6c97-4ace-a754-9f0ea279be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:03.996034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-558b5908-6c97-4ace-a754-9f0ea279be31 None None] MFA Rules not processed for user `8c044c268bc7487ea33bb1ac21a0f5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:03.996716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-558b5908-6c97-4ace-a754-9f0ea279be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:04.075742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1216/2420] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:04.088333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:04.100715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d314a9-92f0-4ba0-9922-8963c654f623 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:04.105773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:04.106432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:04.106696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:04.107011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:04.113394 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:04.177969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:04.179810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:04.191855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1205/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:51:04.301402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14f51-f093-445b-93e7-cb5dd582d045 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:04.301692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14f51-f093-445b-93e7-cb5dd582d045 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:04.301970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14f51-f093-445b-93e7-cb5dd582d045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:04.367515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-65d14f51-f093-445b-93e7-cb5dd582d045 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:04.370297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-65d14f51-f093-445b-93e7-cb5dd582d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:04.492689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1217/2422] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:04.505549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:04.508711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:04.625994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc75deb-537e-477b-a39d-91dcf6c99c41 service glance] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:04.635167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:04.635835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:04.636122 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:04.636434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:04.645162 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:04.646773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:04.664859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1206/2423] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:51:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:51:05.901511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa2e7-0910-4c5a-a9c7-4c007834ea95 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:05.902550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa2e7-0910-4c5a-a9c7-4c007834ea95 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:05.903194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa2e7-0910-4c5a-a9c7-4c007834ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:05.933087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d62fa2e7-0910-4c5a-a9c7-4c007834ea95 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:05.934322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d62fa2e7-0910-4c5a-a9c7-4c007834ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:05.949302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1218/2424] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:05.974836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:05.990413 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022a48b-1d07-43e8-9cc2-1662ff307804 service swift] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:05.998009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:05.999623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:06.000187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:06.000683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:06.023377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:06.025497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaeffc-6073-4486-9797-66e29fe176fb service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:06.045649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1207/2425] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:51:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:51:14.882877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:14.883978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:14.884437 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:14.905974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] MFA Rules not processed for user `a0aa3cf87a4c4c67a5c8a458f81ef61c`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:14.907188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:14.915265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1219/2426] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:51:20.269935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9120d9-54d3-4f86-bc59-3fce0a2c3de9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:20.270562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9120d9-54d3-4f86-bc59-3fce0a2c3de9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:20.270668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9120d9-54d3-4f86-bc59-3fce0a2c3de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:20.292922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ee9120d9-54d3-4f86-bc59-3fce0a2c3de9 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:20.294296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ee9120d9-54d3-4f86-bc59-3fce0a2c3de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:20.304349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:51:20.317863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:20.329922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3887-7a4c-42c3-bb1f-0990fdfa555a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:20.335188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:20.335921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:20.336312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:20.336661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:20.347523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:20.349229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:20.358840 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1220/2428] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:51:37.260671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:37.261247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:37.261358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:37.280452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:51:37.281701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:51:37.290562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1209/2429] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:51:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:51:37.304591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:37.316989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127f47-c2c8-4ed2-84b9-8ec781aec221 service swift] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:37.325472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:37.326138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:37.326435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:37.326709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:37.340099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:37.341833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ddc3d-dffa-4f7e-8d0d-70e538c391da service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:37.354323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1221/2430] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:51:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:51:56.069626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:51:56.078824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc94f9-b21b-4494-922a-98f43a9bf5d0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:51:56.082364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:51:56.082995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:51:56.083274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:51:56.083549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:51:56.092375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:51:56.093837 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cf3b0-0a28-4aca-a88a-7a1fa4b3fb8e service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:51:56.103055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1210/2431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:51:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:52:13.822142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e088-508b-4d7b-a1f9-76ee25e2180a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:13.822706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e088-508b-4d7b-a1f9-76ee25e2180a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:13.822706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6e088-508b-4d7b-a1f9-76ee25e2180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:13.840622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-20f6e088-508b-4d7b-a1f9-76ee25e2180a None None] MFA Rules not processed for user `dd61c2b29a8e448e9d18ac20959f3e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:13.841817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-20f6e088-508b-4d7b-a1f9-76ee25e2180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:13.900440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1222/2432] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:23.388588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f02b-2ef3-4375-85c4-bf7c9fd29843 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:23.389109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f02b-2ef3-4375-85c4-bf7c9fd29843 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:23.389194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f02b-2ef3-4375-85c4-bf7c9fd29843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:23.410635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c729f02b-2ef3-4375-85c4-bf7c9fd29843 None None] MFA Rules not processed for user `4de0f4da2d2e464fb9501fa58e344bed`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:23.412025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c729f02b-2ef3-4375-85c4-bf7c9fd29843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:23.468298 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1211/2433] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:49.881273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:49.881865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:49.881865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:49.901667 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] MFA Rules not processed for user `25229d5ef3be47988accfdee5f9209b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:49.903162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:49.964322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1223/2434] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:52:50.446009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:52:50.446701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:52:50.446701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:52:50.468703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] MFA Rules not processed for user `e2a00f1a578d44abadaa39db5235363a`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:52:50.470852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:52:50.544482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1212/2435] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:53:02.450798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:02.461971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f0c6-4933-4ab4-a142-7deb67b37860 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:02.465866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:02.466616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:02.466903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:02.467247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:02.469213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:02.482899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:02.484297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:02.496917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1224/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:05.513512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:05.515164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:05.529865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2811a8-8af1-4e5f-9417-cd78129694d9 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:05.534657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:05.535322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:05.535605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:05.536136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:05.538739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:05.554479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:05.556617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:05.568964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1213/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:53:10.636102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:10.638499 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:10.717136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9f18e-07b0-46c0-878d-313eb54eba6c service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:10.721697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:10.722754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:10.723231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:10.723738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:10.726328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:10.741155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:10.743741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:10.763088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1225/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:15.324802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:15.326257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:15.392322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b0c80-3d25-43da-8743-ec0e315971f7 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:15.396845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:15.397709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:15.397994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:15.398273 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] PATH_INFO: `/v3/users/dd61c2b29a8e448e9d18ac20959f3e1d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:15.399442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd61c2b29a8e448e9d18ac20959f3e1d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:15.401486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:15.449453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd61c2b29a8e448e9d18ac20959f3e1d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.461632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd61c2b29a8e448e9d18ac20959f3e1d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.462302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd61c2b29a8e448e9d18ac20959f3e1d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.462907 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd61c2b29a8e448e9d18ac20959f3e1d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.470543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd61c2b29a8e448e9d18ac20959f3e1d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.483308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1214/2439] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:53:15 2022] DELETE /identity/v3/users/dd61c2b29a8e448e9d18ac20959f3e1d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:53:15.657866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:15.669273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f442071-ff0a-40fd-9712-5dbd74d634eb service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:15.737146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:15.738060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:15.738342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:15.738618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] PATH_INFO: `/v3/projects/ea67afdf22fd4b41ac5f34bc29f3b7b8` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:15.739798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea67afdf22fd4b41ac5f34bc29f3b7b8)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:15.741728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:15.790572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'request_id': 'req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.797641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'request_id': 'req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.805523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea67afdf22fd4b41ac5f34bc29f3b7b8', 'request_id': 'req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.816210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] The token cache is being invalidate because project ea67afdf22fd4b41ac5f34bc29f3b7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:53:15.816507 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.817188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:15.818804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1226/2440] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:53:15 2022] DELETE /identity/v3/projects/ea67afdf22fd4b41ac5f34bc29f3b7b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:30.626983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:30.629128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:30.714511 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f002-c61c-4a7a-9156-be6ffe36758d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:30.790912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:30.791643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:30.791972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:30.792358 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:30.794531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:30.807723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:30.809520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:30.822052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1215/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:53:31.219925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:31.221662 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:31.278267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeef73-eb2f-4dcd-8a26-42a3b2e2cd66 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:31.283155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:31.283803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:31.284092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:31.284406 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:31.286195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:31.349319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:31.350686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:31.361047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1227/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:35.180025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.182163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:35.197479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa3d0d-e912-4d64-8343-a8b0de9bb7de service nova] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.202129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.203308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.203597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.204055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] PATH_INFO: `/v3/users/4de0f4da2d2e464fb9501fa58e344bed` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.205113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de0f4da2d2e464fb9501fa58e344bed)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.207038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.256145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de0f4da2d2e464fb9501fa58e344bed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.267482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de0f4da2d2e464fb9501fa58e344bed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.268181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de0f4da2d2e464fb9501fa58e344bed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.268811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de0f4da2d2e464fb9501fa58e344bed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.277387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-afc37d6e-c9f0-45bd-834a-4efe36e2bd10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de0f4da2d2e464fb9501fa58e344bed'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.292350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1216/2443] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:53:35 2022] DELETE /identity/v3/users/4de0f4da2d2e464fb9501fa58e344bed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:35.472919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.483964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39ef8c-ddef-4586-aaf7-567d05a1f4aa service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.545182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.546066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.546482 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.546839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] PATH_INFO: `/v3/projects/f6208c73932343aeae12d8cd0983fc77` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.548035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6208c73932343aeae12d8cd0983fc77)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.550293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.598866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6208c73932343aeae12d8cd0983fc77', 'request_id': 'req-010c6720-5efe-49ea-ab47-caedae4ba148'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.606640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6208c73932343aeae12d8cd0983fc77', 'request_id': 'req-010c6720-5efe-49ea-ab47-caedae4ba148'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.616332 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6208c73932343aeae12d8cd0983fc77', 'request_id': 'req-010c6720-5efe-49ea-ab47-caedae4ba148'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.626560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] The token cache is being invalidate because project f6208c73932343aeae12d8cd0983fc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:53:35.626841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.627463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-010c6720-5efe-49ea-ab47-caedae4ba148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:35.629153 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1228/2444] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:53:35 2022] DELETE /identity/v3/projects/f6208c73932343aeae12d8cd0983fc77 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:35.634149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.634431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.634705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.652501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:35.653689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:35.716223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1217/2445] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:53:35.724156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.724454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.724664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.753104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:35.755127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:35.766567 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1229/2446] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:53:35.770813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.780247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7eae9-2b7b-48d4-b459-1190d610efc8 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.785121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.785876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.786247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.786631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.787504 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:53:35.787965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.789721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.802880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1218/2447] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:53:35.806959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.816857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d5e94-3a65-4f08-ab9a-348543736bce None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.821478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.822125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.822414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.822691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.823377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.825328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.852550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1230/2448] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:53:35 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:53:35.856646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.867942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cb00c-368c-4892-af17-732064a399b5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.926120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.926803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.927090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.927365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.928917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.931079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.956134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1219/2449] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:53:35 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:53:35.960508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:35.970833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb4cd1-92e2-4c5b-9148-93d0a56c1296 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:35.975956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:35.976661 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:35.976941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:35.977214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:35.977956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:35.979556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:35.991689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1231/2450] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:53:35.996300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:36.007611 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c3e1-2808-4528-bec0-30bd45dacc93 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:36.012343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:36.013013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:36.013294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:36.013565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:36.014289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:36.016910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7b0a6-15a9-4e2c-b589-6fa545b3a757 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:36.027093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1220/2451] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:53:36.032214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:36.042620 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae1a7-9c72-4d0a-b021-a2f107079fc5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:36.047710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:36.048611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:36.048900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:36.049180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] PATH_INFO: `/v3/projects/e82a2fc737eb4715b627890441776dc4/users/08002583bfb84b79bd4a4d154e82b082/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:36.065175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82a2fc737eb4715b627890441776dc4, user_id=08002583bfb84b79bd4a4d154e82b082, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:36.067801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:36.083322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1232/2452] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:53:36 2022] PUT /identity/v3/projects/e82a2fc737eb4715b627890441776dc4/users/08002583bfb84b79bd4a4d154e82b082/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:53:36.093858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:36.094304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:36.094683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:36.123037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] MFA Rules not processed for user `08002583bfb84b79bd4a4d154e82b082`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:36.124786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:36.196798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1221/2453] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:53:36.208604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:36.210854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:36.280558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2006be-18b7-49ff-8659-763a0ea20f21 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:36.286433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:36.287446 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:36.287909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:36.288396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:36.302425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:36.304874 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:36.318685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1233/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:39.567036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:39.569287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:39.691615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d002a-5c88-40a2-9dd9-754a64776289 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:39.698002 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:39.699102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:39.699477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:39.699792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:39.702631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:39.717043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:39.719198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6e3de-9c9a-44ec-a04f-907b011409c6 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:39.730370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1222/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:45.116501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:45.182156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000ee4-2b76-4fc8-9865-dc1271217453 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:45.186924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:45.187782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:45.188061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:45.188409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] PATH_INFO: `/v3/users/08002583bfb84b79bd4a4d154e82b082` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:45.189750 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08002583bfb84b79bd4a4d154e82b082)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:45.191683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:45.247245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08002583bfb84b79bd4a4d154e82b082'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.265821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08002583bfb84b79bd4a4d154e82b082'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.266594 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08002583bfb84b79bd4a4d154e82b082'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.267419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08002583bfb84b79bd4a4d154e82b082'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.278887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08002583bfb84b79bd4a4d154e82b082'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.295995 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1234/2456] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:53:45 2022] DELETE /identity/v3/users/08002583bfb84b79bd4a4d154e82b082 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:45.301802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:45.302320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:45.302813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:45.324814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:45.326217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:45.386079 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1223/2457] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:53:45.396106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:45.397535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:45.452774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb9eb-41e0-460a-b3cf-59365e3667f2 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:45.456350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:45.456993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:45.457278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:45.457553 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:45.466440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:45.467938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d03133-2ca9-49d4-a3f6-8e89bc719b3c service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:45.477908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1235/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:45.773582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:45.775206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:45.790592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c276f54-ddc0-4691-b3fe-d8b070ec0f28 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:45.796111 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:45.797294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:45.797786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:45.798248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] PATH_INFO: `/v3/projects/e82a2fc737eb4715b627890441776dc4` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:45.799933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82a2fc737eb4715b627890441776dc4)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:45.802077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:45.854617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82a2fc737eb4715b627890441776dc4', 'request_id': 'req-bead518e-ddf0-4c89-82fc-131bd16f3d32'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.862539 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82a2fc737eb4715b627890441776dc4', 'request_id': 'req-bead518e-ddf0-4c89-82fc-131bd16f3d32'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.870459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82a2fc737eb4715b627890441776dc4', 'request_id': 'req-bead518e-ddf0-4c89-82fc-131bd16f3d32'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.881745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] The token cache is being invalidate because project e82a2fc737eb4715b627890441776dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:53:45.882067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.882660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bead518e-ddf0-4c89-82fc-131bd16f3d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:45.884214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1224/2459] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:53:45 2022] DELETE /identity/v3/projects/e82a2fc737eb4715b627890441776dc4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:45.891854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:45.892058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:45.892440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:45.911717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:45.912957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:45.991659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1236/2460] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:53:46.001008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.001371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.001574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.022059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:46.023802 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:46.036524 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1225/2461] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:53:46.040523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.050377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5372d5d-de9f-4c4a-aa67-d29942147dc4 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.055682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.056906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.057279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.057648 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.058583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:53:46.059038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.061348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.077610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1237/2462] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:53:46.082331 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.095342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96fe27-b46a-44de-9385-ef7e954233cc None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.100666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.101390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.101795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.102192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.103063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.105154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.134387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1226/2463] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:53:46 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:53:46.138120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.149424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8230a8-b0d6-4036-a51a-df40a6b8cd9b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.222988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.224115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.224640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.225140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.226300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.228973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.257515 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1238/2464] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:53:46 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:53:46.261818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.286227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf7113-1eda-47f6-9a0c-78c1b3eaf68f admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.296120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.297064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.297462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.297830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.298671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.300754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.319345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1227/2465] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:53:46.320560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.332194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2643a68-e396-4aa5-92ec-d39b585e8522 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.338067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.338740 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.339312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.339562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.341286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.344409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37bd86-ac38-4f44-b5cb-98d6f8d1b3f4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.359388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1239/2466] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:53:46.364067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.382164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435c5ea-835f-449e-875c-0b70c1bdef27 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.391791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.395021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.395490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.395953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] PATH_INFO: `/v3/projects/cd8f50b9376447919a1207df99108a1c/users/54a8e878e1b44de98dd4d62142ceda5a/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.416759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8f50b9376447919a1207df99108a1c, user_id=54a8e878e1b44de98dd4d62142ceda5a, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.422582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.448691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1228/2467] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:53:46 2022] PUT /identity/v3/projects/cd8f50b9376447919a1207df99108a1c/users/54a8e878e1b44de98dd4d62142ceda5a/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:46.460386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48da8a8-34ef-4e88-88e4-8a3a68122232 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.460813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48da8a8-34ef-4e88-88e4-8a3a68122232 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.461570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48da8a8-34ef-4e88-88e4-8a3a68122232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.496451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-a48da8a8-34ef-4e88-88e4-8a3a68122232 None None] MFA Rules not processed for user `54a8e878e1b44de98dd4d62142ceda5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:46.497689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a48da8a8-34ef-4e88-88e4-8a3a68122232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:46.573720 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1240/2468] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:53:46.586779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:46.588480 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:46.651898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50131289-65e2-45b1-ba1b-de471a6aefa5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:46.655794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:46.656501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:46.657102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:46.657383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:46.666606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:46.668320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:46.678735 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1229/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:47.585653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:47.586062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:47.586219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:47.604809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:53:47.606048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:47.665829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1241/2470] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:53:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:53:47.720756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:47.722703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:47.795675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb07d-c180-4ea6-8435-55c904af1e61 service glance] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:47.801599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:47.802256 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:47.802541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:47.802817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:47.812314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:47.815663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:47.830314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1230/2471] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:53:53.588798 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:53.590486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:53.671686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd71e6-d05b-4193-b0ed-4cd7366092d9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:53.678957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:53.680491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:53.680882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:53.681265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:53.684634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:53.755525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:53.757268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:53.768351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1242/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:55.473779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:55.475458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:55.571962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e4b6-099e-4fd5-a8da-ed47af76b3b8 service swift] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:55.577609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:55.578635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:55.578945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:55.579206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] PATH_INFO: `/v3/users/a0aa3cf87a4c4c67a5c8a458f81ef61c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:55.580452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0aa3cf87a4c4c67a5c8a458f81ef61c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:55.582410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:55.604535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:55.628263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcd109-03ed-4bde-89ef-9101bdf8c4ae service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:55.663975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0aa3cf87a4c4c67a5c8a458f81ef61c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:55.666110 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:55.666959 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:55.667326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:55.667806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:55.671208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:55.678134 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0aa3cf87a4c4c67a5c8a458f81ef61c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:55.680605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0aa3cf87a4c4c67a5c8a458f81ef61c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:55.681289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0aa3cf87a4c4c67a5c8a458f81ef61c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:55.689664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0aa3cf87a4c4c67a5c8a458f81ef61c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:55.707189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1231/2473] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:53:55 2022] DELETE /identity/v3/users/a0aa3cf87a4c4c67a5c8a458f81ef61c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:55.756744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:55.758478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:55.769024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1243/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:53:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:53:55.923786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:55.925784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:56.038869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e015cd6-0c1e-49a6-a448-daee59a6779e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:56.046038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:56.047811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:56.048109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:56.048556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] PATH_INFO: `/v3/projects/ad2249e85fd741258c91142e19edc714` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:56.050368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2249e85fd741258c91142e19edc714)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:56.052901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:56.115799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2249e85fd741258c91142e19edc714', 'request_id': 'req-3ab30ebb-ef77-4c78-84dc-c145deaf845c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.123822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2249e85fd741258c91142e19edc714', 'request_id': 'req-3ab30ebb-ef77-4c78-84dc-c145deaf845c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.133590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2249e85fd741258c91142e19edc714', 'request_id': 'req-3ab30ebb-ef77-4c78-84dc-c145deaf845c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.147558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] The token cache is being invalidate because project ad2249e85fd741258c91142e19edc714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:53:56.147838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.148773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.150716 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1232/2475] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:53:55 2022] DELETE /identity/v3/projects/ad2249e85fd741258c91142e19edc714 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:56.156614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:56.172980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf405-4817-4014-ab1d-ddd58731a934 service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:56.236088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:56.237001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:56.237285 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:56.237562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] PATH_INFO: `/v3/users/8c044c268bc7487ea33bb1ac21a0f5ce` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:56.238743 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c044c268bc7487ea33bb1ac21a0f5ce)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:56.240710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:56.285733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c044c268bc7487ea33bb1ac21a0f5ce'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.297613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c044c268bc7487ea33bb1ac21a0f5ce'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.298249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c044c268bc7487ea33bb1ac21a0f5ce'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.298847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c044c268bc7487ea33bb1ac21a0f5ce'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.305707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b2302cc7-efd1-40d7-b643-07cc87acf919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c044c268bc7487ea33bb1ac21a0f5ce'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.319307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1244/2476] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:53:56 2022] DELETE /identity/v3/users/8c044c268bc7487ea33bb1ac21a0f5ce => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:53:56.516052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:53:56.517634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:53:56.532543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab30ebb-ef77-4c78-84dc-c145deaf845c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:53:56.598595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:53:56.599470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:53:56.599748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:53:56.600018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] PATH_INFO: `/v3/projects/8882897bb59441a0a22e90b476669850` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:53:56.601437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8882897bb59441a0a22e90b476669850)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:53:56.603455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:53:56.655185 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8882897bb59441a0a22e90b476669850', 'request_id': 'req-ffa55164-0260-40a9-aa1a-02789642679d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.661773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8882897bb59441a0a22e90b476669850', 'request_id': 'req-ffa55164-0260-40a9-aa1a-02789642679d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.672096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8882897bb59441a0a22e90b476669850', 'request_id': 'req-ffa55164-0260-40a9-aa1a-02789642679d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.688956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] The token cache is being invalidate because project 8882897bb59441a0a22e90b476669850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:53:56.689354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.690068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:53:56.692029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1233/2477] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:53:56 2022] DELETE /identity/v3/projects/8882897bb59441a0a22e90b476669850 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:16.217479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:16.218600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:16.218880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:16.238240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:16.239790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:16.316476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1245/2478] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:16.334810 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:16.338322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:16.416599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa55164-0260-40a9-aa1a-02789642679d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:16.422365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:16.423026 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:16.423309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:16.423590 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:16.432322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:16.434113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12914a7-4cee-41a4-9916-313acc780585 service swift] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:16.442840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1234/2479] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:54:18.152136 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:18.154177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:18.222907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5f209-1cd7-4d3c-90b0-3dc35ca9e140 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:18.229162 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:18.230113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:18.230401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:18.230691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] PATH_INFO: `/v3/users/54a8e878e1b44de98dd4d62142ceda5a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:18.232988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a8e878e1b44de98dd4d62142ceda5a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:18.235403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:18.300722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a8e878e1b44de98dd4d62142ceda5a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:18.322925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a8e878e1b44de98dd4d62142ceda5a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:18.324336 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a8e878e1b44de98dd4d62142ceda5a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:18.324954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a8e878e1b44de98dd4d62142ceda5a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:18.333639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a8e878e1b44de98dd4d62142ceda5a'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:18.361889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1246/2480] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:54:18 2022] DELETE /identity/v3/users/54a8e878e1b44de98dd4d62142ceda5a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:18.366397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:18.366902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:18.367000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:18.389639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:18.391149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:18.431066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:18.432764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:18.479915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1235/2481] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:18.492194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:18.494103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:18.644806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247cba3-0392-4de2-9938-a50f2b5f8259 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:18.647855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcffb6c-fe03-4cc1-886e-ff561c720fe3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:18.658049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:18.658862 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:18.659237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:18.659602 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:18.662377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:18.662813 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:18.663565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:18.664000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:18.664431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:18.675395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:18.677720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:18.678006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:18.679458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2426c-6de9-49c3-8037-ac416ef76547 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:18.691266 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1236/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:18.704096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1247/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:19.020848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.022431 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:19.042991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35898b68-d8ec-4147-b03b-a51eb742cebb service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.051248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.052943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.052943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.053174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] PATH_INFO: `/v3/projects/cd8f50b9376447919a1207df99108a1c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.054284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8f50b9376447919a1207df99108a1c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.056234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.119345 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8f50b9376447919a1207df99108a1c', 'request_id': 'req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:19.137631 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8f50b9376447919a1207df99108a1c', 'request_id': 'req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:19.150028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8f50b9376447919a1207df99108a1c', 'request_id': 'req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:19.166064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] The token cache is being invalidate because project cd8f50b9376447919a1207df99108a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:54:19.166643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:19.167589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c718c94c-d53c-44a6-ab6d-fc571e07d5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:19.172847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1237/2484] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:54:19 2022] DELETE /identity/v3/projects/cd8f50b9376447919a1207df99108a1c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:19.178914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.179419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.179516 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.213036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:19.214257 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:19.300341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1248/2485] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:19.307962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.308602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.309097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.330347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:19.333766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:19.373505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1238/2486] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:19.374829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.390335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7b14d-43a2-4b65-819d-faa7d44d080b None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.405177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.405875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.406170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.406457 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.407222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:54:19.407873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.409179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.427134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1249/2487] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:54:19.430902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.440937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344518e6-f3ab-42b0-bb76-01bb53898e37 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.448049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.449072 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.449465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.449850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.450798 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.452879 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.505975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1239/2488] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:54:19 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:54:19.507076 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.522304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74d6a-2826-4b88-a676-a6323553b9f5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.630630 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.631245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.631529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.631802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.634355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.636363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.681333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1250/2489] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:54:19 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:54:19.687926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.707848 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba333-226c-4179-8022-4840c36fa223 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.717963 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.718971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.719426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.719875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.720836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.722657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.744569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1240/2490] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:54:19.745759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.766524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9d3c-750e-46ef-9c18-ee7707f70f07 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.777635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.778538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.778936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.779359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.780213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.782067 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e0476-50ca-4b0e-9a9a-f62ee4f92778 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.802396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1251/2491] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:54:19.806201 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:19.820898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9f00-706b-42a4-b9e6-3d3af18efae6 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:19.827402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:19.828578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.829187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.829609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] PATH_INFO: `/v3/projects/9f6c3554c8934f4c87185c29cf362947/users/fabf3ad714aa492b93d8f6fb5e74f0b3/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.870707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6c3554c8934f4c87185c29cf362947, user_id=fabf3ad714aa492b93d8f6fb5e74f0b3, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:19.873923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:19.915794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1241/2492] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:54:19 2022] PUT /identity/v3/projects/9f6c3554c8934f4c87185c29cf362947/users/fabf3ad714aa492b93d8f6fb5e74f0b3/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:19.917894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:19.918308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:19.918711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:19.972948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] MFA Rules not processed for user `fabf3ad714aa492b93d8f6fb5e74f0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:19.974823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:20.074024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1252/2493] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:20.087653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:20.094694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:20.181730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb200bbc-02be-4f0a-813c-d1edde130a11 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:20.190144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:20.191051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:20.191434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:20.191826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:20.202803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:20.204773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:20.224446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1242/2494] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:27.305936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:27.307315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:27.367043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e8e5-88c9-4589-a873-3689e4c832dc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:27.370576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:27.371213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:27.371491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:27.371800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:27.374473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:27.438092 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:27.439522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:27.449195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1253/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:30.764077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:30.767051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:30.793141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005ccc-a2d5-4453-94c6-fd1d9596147e service glance] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:30.806270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:30.808019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:30.808418 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:30.808777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] PATH_INFO: `/v3/users/e2a00f1a578d44abadaa39db5235363a` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:30.810363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a00f1a578d44abadaa39db5235363a)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:30.812663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:30.879665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a00f1a578d44abadaa39db5235363a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:30.893667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a00f1a578d44abadaa39db5235363a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:30.894467 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a00f1a578d44abadaa39db5235363a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:30.895143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a00f1a578d44abadaa39db5235363a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:30.901988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a00f1a578d44abadaa39db5235363a'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:30.916934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1243/2496] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:54:30 2022] DELETE /identity/v3/users/e2a00f1a578d44abadaa39db5235363a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:30.930079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:30.931666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:30.943770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2174f72-f762-47b4-b8b1-735022d8909a service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.000793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.001476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.002003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.002288 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.004402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.016864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.018548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b0bb5-c293-4c13-8594-00d6b4be12f9 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.027721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1254/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:31.112996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.115093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.144054 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9483ab-b667-4d59-9a82-cd26f7037fec None None] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.144414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9483ab-b667-4d59-9a82-cd26f7037fec None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.144658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9483ab-b667-4d59-9a82-cd26f7037fec None None] PATH_INFO: `/` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.146171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1255/2498] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 16:54:31.156689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.157106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.157237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.180726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.181984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.207709 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf319c17-4eb5-468a-b390-d259bae18630 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.213850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.214740 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.215018 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.216090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] PATH_INFO: `/v3/projects/6c526b65f8454d7e84b29236f42417f7` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.217017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c526b65f8454d7e84b29236f42417f7)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.219389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.256142 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1256/2499] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:31.268197 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.269699 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.281945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c526b65f8454d7e84b29236f42417f7', 'request_id': 'req-73809439-40ec-4883-951d-ed41a7e145ac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:31.288578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c526b65f8454d7e84b29236f42417f7', 'request_id': 'req-73809439-40ec-4883-951d-ed41a7e145ac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:31.302164 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c526b65f8454d7e84b29236f42417f7', 'request_id': 'req-73809439-40ec-4883-951d-ed41a7e145ac'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:31.318048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] The token cache is being invalidate because project 6c526b65f8454d7e84b29236f42417f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:54:31.318369 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:31.319153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-73809439-40ec-4883-951d-ed41a7e145ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:31.321293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1244/2500] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:54:31 2022] DELETE /identity/v3/projects/6c526b65f8454d7e84b29236f42417f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:31.326096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0e4c-ea12-49c5-8360-f406566108ef None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.326757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0e4c-ea12-49c5-8360-f406566108ef None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.327038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0e4c-ea12-49c5-8360-f406566108ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.341933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c08533-6ab2-4a1e-acda-42fa04824470 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.345354 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-66ab0e4c-ea12-49c5-8360-f406566108ef None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.346550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-66ab0e4c-ea12-49c5-8360-f406566108ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.391730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64b24a8c20fd44f99cd7d961c259ce0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.392411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.392698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.392981 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.394765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.404486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1245/2501] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:31.412199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.412548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.412832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.433286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.434619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.442629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1246/2502] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:31.448771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.457864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21429ef5-5463-4297-bf1c-0f74805b9a2d None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.463434 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.464083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.464395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.464668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.465982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:54:31.466477 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.468119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.474533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.478909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.481884 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1247/2503] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:54:31.488678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.497663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1257/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:54:31.502333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131848c-6353-43dc-992c-5e3e1d966a28 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.507069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.507784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.508067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.508373 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.509094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.510998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626aa042-147c-4d3f-a556-bd8d00730c91 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.547594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1248/2505] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:54:31.548973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.559652 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28847-1fee-41ad-a580-7ff800a355f8 service glance] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.566163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ef86-3873-4a35-a521-3cf9ab57818d None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.566449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ef86-3873-4a35-a521-3cf9ab57818d None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.566723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ef86-3873-4a35-a521-3cf9ab57818d None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.568076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1249/2506] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:54:31.572521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.572808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.573085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.591595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] MFA Rules not processed for user `95bc0f08dd894e9c8edc4c90001f1844`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.592947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.619426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.620639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.620962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.621260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.622842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.625133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.647512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1258/2507] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:54:31.647743 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1250/2508] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:31.649222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.658257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.659802 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93138e1-3724-4db3-b373-eef95a65e814 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.660376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.664399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.665043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.665322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.665596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.666315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.667887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.670924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b703022-be17-42e6-979f-39e10fea0f94 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.674976 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.675693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.676057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.676227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.681504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1259/2509] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:54:31.684597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.685954 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.686430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.694651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1251/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:54:31.697466 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595393e0-83a7-4739-9298-1028b9a0d456 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.702779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.703434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.703715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.703988 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.704745 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.706366 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9083ae7-a53d-4f25-81aa-7757b9d0a766 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.717556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1260/2511] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:54:31.721673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.734593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd52f-8664-411a-8798-0d4f430d8cdd service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.739230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.740103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.740417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.740696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] PATH_INFO: `/v3/projects/a46a3e1f43434294a8e3d1ef8c04061b/users/69585611ca7547adb43378445b4f1521/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.755346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46a3e1f43434294a8e3d1ef8c04061b, user_id=69585611ca7547adb43378445b4f1521, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.758073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffd509-34d0-46d5-8bbf-4c0b75ea9758 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.772658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1252/2512] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:54:31 2022] PUT /identity/v3/projects/a46a3e1f43434294a8e3d1ef8c04061b/users/69585611ca7547adb43378445b4f1521/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:54:31.776903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.777261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.777603 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.783647 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049168a-0073-40cc-9fb2-ab9038de1e7a None None] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.784025 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049168a-0073-40cc-9fb2-ab9038de1e7a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.784502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049168a-0073-40cc-9fb2-ab9038de1e7a None None] PATH_INFO: `/` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.785784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1253/2513] 10.222.0.48 () {54 vars in 921 bytes} [Tue May 10 16:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 16:54:31.791429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.791705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.792013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.796932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.798209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.810470 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] MFA Rules not processed for user `7e2c583bb342443e935446db4b26dcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:31.811661 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.855999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1261/2514] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:31.865739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.880544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1254/2515] 10.222.0.48 () {58 vars in 1018 bytes} [Tue May 10 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:31.892123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:31.893601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:31.921365 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae643802-54f8-45f9-9613-88a59c1bc8fb None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.925307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.925951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.926231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.926531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.935644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.937123 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.947402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1262/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:54:31.948985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d645557-137b-4f99-b55d-773ec8f776f3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:31.955068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:31.955724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:31.956005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:31.956309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:31.967446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:31.969102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466d39-ab2c-4a65-9c89-9b2f01374960 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:31.980846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1255/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:54:32.043203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:32.045459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:32.118167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f91161-4339-4296-b0d7-8ee45f47f671 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:32.125276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:32.125934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:32.126225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:32.126503 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:32.128449 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:32.140665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:32.142249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:32.152730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1263/2518] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:34.335191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1eba-b6d5-4fd3-b645-e83733021cf9 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:34.335751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1eba-b6d5-4fd3-b645-e83733021cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:34.336117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1eba-b6d5-4fd3-b645-e83733021cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:34.355138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-155c1eba-b6d5-4fd3-b645-e83733021cf9 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:34.356420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-155c1eba-b6d5-4fd3-b645-e83733021cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:34.416901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1256/2519] 10.222.0.48 () {58 vars in 1009 bytes} [Tue May 10 16:54:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:34.430016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:34.431517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:34.521417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db870b87-f348-4e8f-aff1-826432e1b643 service placement] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:34.530028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:34.532384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:34.532757 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:34.533058 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:34.545748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:34.547391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:34.558561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1264/2520] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:54:38.554788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013351d-e586-4fdb-96a0-4fa131b23d1b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:38.555280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013351d-e586-4fdb-96a0-4fa131b23d1b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:38.555384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013351d-e586-4fdb-96a0-4fa131b23d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:38.639311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-3013351d-e586-4fdb-96a0-4fa131b23d1b None None] MFA Rules not processed for user `69585611ca7547adb43378445b4f1521`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:38.640934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3013351d-e586-4fdb-96a0-4fa131b23d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:38.756252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1257/2521] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:38.773314 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:38.777540 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:38.828922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb59ce3-3bcf-4324-a2fa-519300ec5da7 service swift] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:38.843271 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:38.844429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:38.844907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:38.845400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:38.869931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:38.872611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:38.897130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1265/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:41.271383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:41.271913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:41.272073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:41.318428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] MFA Rules not processed for user `69585611ca7547adb43378445b4f1521`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:41.321259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:41.337284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1258/2523] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:41.972568 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:41.989614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a93514-576d-42ba-92fe-73993f091797 service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:42.002744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:42.003797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:42.004084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:42.004487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:42.009443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:42.046143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:42.048102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90a638-f87a-466e-9d56-4bd05697ba71 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:42.085102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1266/2524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:48.191167 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:48.192671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:48.206695 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d21d2-3d94-41a1-a181-4c48609c992a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:48.211123 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:48.211978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:48.212265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:48.212571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] PATH_INFO: `/v3/users/fabf3ad714aa492b93d8f6fb5e74f0b3` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:48.213745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fabf3ad714aa492b93d8f6fb5e74f0b3)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:48.216779 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:48.263856 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fabf3ad714aa492b93d8f6fb5e74f0b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.274820 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fabf3ad714aa492b93d8f6fb5e74f0b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.275479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fabf3ad714aa492b93d8f6fb5e74f0b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.276082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fabf3ad714aa492b93d8f6fb5e74f0b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.283251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fabf3ad714aa492b93d8f6fb5e74f0b3'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.295836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1259/2525] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:54:48 2022] DELETE /identity/v3/users/fabf3ad714aa492b93d8f6fb5e74f0b3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:48.300624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:48.301134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:48.301251 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:48.318508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:48.319690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:48.380993 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1267/2526] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:48.391814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:48.393342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:48.457583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee4146-a3e2-4f43-a055-14dd276efa15 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:48.461293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:48.462019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:48.462309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:48.462595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:48.473153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:48.474612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd596422-90e6-4dcd-b5d0-1a9f2456b252 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:48.485363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1260/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:48.779359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:48.780909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:48.793409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1e9ed-832a-433c-9ec2-1d8a404ab733 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:48.797715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:48.798582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:48.798866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:48.799397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] PATH_INFO: `/v3/projects/9f6c3554c8934f4c87185c29cf362947` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:48.800645 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6c3554c8934f4c87185c29cf362947)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:48.802579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:48.853240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6c3554c8934f4c87185c29cf362947', 'request_id': 'req-58918fb4-7211-459f-b40d-1e0c05073214'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.861484 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6c3554c8934f4c87185c29cf362947', 'request_id': 'req-58918fb4-7211-459f-b40d-1e0c05073214'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.872017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6c3554c8934f4c87185c29cf362947', 'request_id': 'req-58918fb4-7211-459f-b40d-1e0c05073214'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.886333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] The token cache is being invalidate because project 9f6c3554c8934f4c87185c29cf362947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:54:48.886855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.888246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-58918fb4-7211-459f-b40d-1e0c05073214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:48.893909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1268/2528] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:54:48 2022] DELETE /identity/v3/projects/9f6c3554c8934f4c87185c29cf362947 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:48.895675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:48.895974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:48.896255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:48.928051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:48.929641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:49.031494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1261/2529] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:49.038952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.039244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.039668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.065310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:49.066978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:49.080541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1269/2530] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:49.081049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.091997 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65667a-00f9-4523-91c4-6da57ae8f10c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.098724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.099408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.099925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.100215 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.101013 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:54:49.101328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.103030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.116721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1262/2531] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:54:49.121941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.133317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c25e5-29c8-4f10-b3cd-a0e266b895b3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.142341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.143729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.143729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.143941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.144639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.146554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.180308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1270/2532] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:54:49 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:54:49.182652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.193029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e474-0ba1-4a13-b3df-50e66f0f90ad admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.249022 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.249712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.250007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.250299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.251014 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.253267 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.274157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1263/2533] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:54:49 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:54:49.278583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.288998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3fa79-3cea-4ac1-bbb9-9a561b5644b0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.294303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.295007 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.295346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.295626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.296387 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.297989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.308363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1271/2534] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:54:49.313269 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.323110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5159e2f-cabe-40f2-8ea0-e2d63db5d066 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.328074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.328772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.329063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.329342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.330062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.331656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9b724-086a-484f-b469-3d526c0b352e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.342425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1264/2535] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:54:49.346646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.357186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7263c5-bb8d-4377-b68e-15168a0f072c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.361753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.362625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.362920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.363788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] PATH_INFO: `/v3/projects/744f2f6522c44bbca609f0f46843d0ba/users/209a453c0a5b4d03aea7fcefe0adec7b/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.377972 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=744f2f6522c44bbca609f0f46843d0ba, user_id=209a453c0a5b4d03aea7fcefe0adec7b, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.380649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.393436 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1272/2536] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:54:49 2022] PUT /identity/v3/projects/744f2f6522c44bbca609f0f46843d0ba/users/209a453c0a5b4d03aea7fcefe0adec7b/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:49.405591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e750-e9a9-47aa-961b-2d1fd5fd24be None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.405885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e750-e9a9-47aa-961b-2d1fd5fd24be None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.406172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e750-e9a9-47aa-961b-2d1fd5fd24be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.433085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9735e750-e9a9-47aa-961b-2d1fd5fd24be None None] MFA Rules not processed for user `209a453c0a5b4d03aea7fcefe0adec7b`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:49.434785 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9735e750-e9a9-47aa-961b-2d1fd5fd24be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:49.497941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1265/2537] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:54:49.508674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:49.510416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:49.575244 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca0cd3-a58f-404a-a44a-3b0ad67c0f50 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:49.580692 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:49.581348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:49.581633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:49.581910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:49.591749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:49.593223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:49.602091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1273/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:54:50.553748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:50.554317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:50.554454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:50.571948 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] MFA Rules not processed for user `3f5322815d884ee89bf30f2b0fd84287`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:50.573673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:50.638449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1266/2539] 10.222.0.48 () {58 vars in 967 bytes} [Tue May 10 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:50.660711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:50.662132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:50.737994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e678d3-270f-4cb9-a27e-205a654c6931 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:50.744325 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74292c819dee46f788c7b9af0b9fce7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:50.744976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:50.745598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:50.745598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:50.756693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:50.758933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2f19-ffc2-4277-aaad-56bf7a51eaa9 service swift] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:50.768331 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1274/2540] 10.222.0.48 () {60 vars in 1384 bytes} [Tue May 10 16:54:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 16:54:59.376999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:59.439599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cca93-3a3d-4498-9fd8-08de60fdd689 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:59.444048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:59.444930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:59.445212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:59.445486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] PATH_INFO: `/v3/users/209a453c0a5b4d03aea7fcefe0adec7b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:59.446646 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209a453c0a5b4d03aea7fcefe0adec7b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:59.448609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:59.492656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209a453c0a5b4d03aea7fcefe0adec7b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:59.504202 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209a453c0a5b4d03aea7fcefe0adec7b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:59.504933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209a453c0a5b4d03aea7fcefe0adec7b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:59.505523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209a453c0a5b4d03aea7fcefe0adec7b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:59.513353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209a453c0a5b4d03aea7fcefe0adec7b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:54:59.526506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1267/2541] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:54:59 2022] DELETE /identity/v3/users/209a453c0a5b4d03aea7fcefe0adec7b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:54:59.531951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:59.532486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:59.532600 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:59.549675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:54:59.550887 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:59.608957 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1275/2542] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:54:59.619748 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:59.621414 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:59.684936 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e52576-d793-4997-889b-49e806da9011 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:59.688685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:59.689337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:59.689630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:59.689910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:59.699351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:54:59.700859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd275-82cd-4d44-8fcc-a6ea6b709d92 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:54:59.710241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1268/2543] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:54:59.974545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:54:59.975997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:54:59.989786 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f31705-f6a4-49a0-9a2d-d970203c4882 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:54:59.995141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:54:59.997050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:54:59.997346 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:54:59.997623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] PATH_INFO: `/v3/projects/744f2f6522c44bbca609f0f46843d0ba` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:54:59.998968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744f2f6522c44bbca609f0f46843d0ba)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.000992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.048709 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744f2f6522c44bbca609f0f46843d0ba', 'request_id': 'req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:00.055072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744f2f6522c44bbca609f0f46843d0ba', 'request_id': 'req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:00.063097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744f2f6522c44bbca609f0f46843d0ba', 'request_id': 'req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:00.073052 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] The token cache is being invalidate because project 744f2f6522c44bbca609f0f46843d0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:00.073338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:00.074906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3bc31e1c-3f0a-47aa-93af-52182b1ddb43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:00.076483 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1276/2544] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:54:59 2022] DELETE /identity/v3/projects/744f2f6522c44bbca609f0f46843d0ba => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:00.081630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.081918 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.082192 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.099729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:00.101108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:00.161207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1269/2545] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:00.169538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.169986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.170363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.189190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:00.190382 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:00.198230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1277/2546] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:00.203435 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.212832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c9155-25ad-4ec7-9647-1c6427c68159 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.217598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.218240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.218521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.218794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.219531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:00.219823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.221445 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.233809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1270/2547] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:00.238078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.247772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583012fb-34ea-4ebc-8f04-8e278d977a98 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.252413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.253049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.253330 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.253599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.254286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.256173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.281925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1278/2548] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:00 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:00.285974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.296362 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2236903-0b41-4884-8f35-080e4074525e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.349672 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.350329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.350612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.350887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.351574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.353844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.373970 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1271/2549] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:00 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:00.378085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.387925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47deeda8-957a-4bdf-b2d9-eb2c0dbaaafc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.392517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.393169 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.393456 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.393731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.394454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.396050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.406335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1279/2550] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:00.410352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.421853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a518b-55df-4990-ab43-92ec03197a7c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.426698 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.427350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.427635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.427912 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.428665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.430262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a835-0a07-4a2b-b29c-0f4798fbb072 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.441179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1272/2551] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:00.445383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.455708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045510df-225b-400a-bee3-e38bdeac5945 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.460588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.461459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.461748 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.462024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] PATH_INFO: `/v3/projects/d0bac21bee224dcd8b7cfedcf4f98fc3/users/50e01dc10c4b4bc6baded0e78bec1a00/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.477281 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bac21bee224dcd8b7cfedcf4f98fc3, user_id=50e01dc10c4b4bc6baded0e78bec1a00, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.479948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.492916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1280/2552] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:00 2022] PUT /identity/v3/projects/d0bac21bee224dcd8b7cfedcf4f98fc3/users/50e01dc10c4b4bc6baded0e78bec1a00/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:00.504241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.504596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.504880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.532664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] MFA Rules not processed for user `50e01dc10c4b4bc6baded0e78bec1a00`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:00.533889 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:00.600159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1273/2553] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:55:00.611524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:00.613255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:00.669592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9bbd-8eda-4b8b-89e1-bf4734040fd6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:00.673323 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:00.674159 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:00.674440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:00.674719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:00.685950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:00.687394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a30f3-fc53-415f-9cce-4dc6bb15f815 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:00.696187 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1281/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:07.704112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:07.771415 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7a94-b7ab-4577-94fb-048709aec50f None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:07.775938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:07.777316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:07.777606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:07.777882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] PATH_INFO: `/v3/users/50e01dc10c4b4bc6baded0e78bec1a00` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:07.779074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e01dc10c4b4bc6baded0e78bec1a00)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:07.781047 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:07.826915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e01dc10c4b4bc6baded0e78bec1a00'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:07.839051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e01dc10c4b4bc6baded0e78bec1a00'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:07.840608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e01dc10c4b4bc6baded0e78bec1a00'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:07.841448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e01dc10c4b4bc6baded0e78bec1a00'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:07.851766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e01dc10c4b4bc6baded0e78bec1a00'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:07.865558 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1274/2555] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:07 2022] DELETE /identity/v3/users/50e01dc10c4b4bc6baded0e78bec1a00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:07.870157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:07.870641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:07.870772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:07.888533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:07.889731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:07.945411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1282/2556] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:07.955864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:07.957994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.013194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a83f41-cfca-4799-bcb6-e047a15bc499 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.016877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.017516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.017817 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.018076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.027322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.028838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ec6f3-6b44-411e-afb7-afc960e581d8 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.038004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1275/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:08.322240 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.325127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.336118 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45debeb2-e036-46e4-8a69-ce2136e3b3df None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.341519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.342384 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.342664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.342936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] PATH_INFO: `/v3/projects/d0bac21bee224dcd8b7cfedcf4f98fc3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.344151 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bac21bee224dcd8b7cfedcf4f98fc3)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.346133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.396996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bac21bee224dcd8b7cfedcf4f98fc3', 'request_id': 'req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:08.404033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bac21bee224dcd8b7cfedcf4f98fc3', 'request_id': 'req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:08.410579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bac21bee224dcd8b7cfedcf4f98fc3', 'request_id': 'req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:08.420919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] The token cache is being invalidate because project d0bac21bee224dcd8b7cfedcf4f98fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:08.421206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:08.421838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-3cbf6fc5-d352-42a3-abb5-ad6d272dc3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:08.423367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1283/2558] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:08 2022] DELETE /identity/v3/projects/d0bac21bee224dcd8b7cfedcf4f98fc3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:08.428486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.428784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.429068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.446818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:08.448020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.507586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1276/2559] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:08.516180 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.516509 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.516792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.534946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:08.536156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.544658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1284/2560] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:08.549088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.558965 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174b7c-35d1-4453-9900-4d89f579c793 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.563656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.564321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.564607 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.564887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.565624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:08.565928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.567520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.579584 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1277/2561] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:08.583935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.593034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eab5f-a946-46c4-9081-177a2b0266ba None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.597580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.598215 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.598494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.598767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.599451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.601409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.626440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1285/2562] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:08 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:08.630636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.641419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352231a-2e72-4e2c-843e-b62249257e9c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.696449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.697031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.697311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.697582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.698271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.700924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.720449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1278/2563] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:08 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:08.724627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.734717 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574b2aa-fa16-44a9-bdb7-c96e0dd227a1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.739220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.739871 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.740152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.740470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.741194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.742850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.753340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1286/2564] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:08.757260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.768259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234d91-1d16-4a09-871f-577b5fb79411 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.772878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.773528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.773815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.774091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.774816 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.776556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a22f67-5645-40d6-946b-ed7b5ac93f1f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.786213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1279/2565] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:08.790353 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.800549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2e802-a286-408b-bbe9-4f24030f45bc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.805231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.806100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.806381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.806658 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] PATH_INFO: `/v3/projects/0b8348f4bffd44e7b0da6367a1011709/users/fe1f5f6882eb4a9aa869ad32fbdb0d92/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.821144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8348f4bffd44e7b0da6367a1011709, user_id=fe1f5f6882eb4a9aa869ad32fbdb0d92, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:08.824558 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:08.837326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1287/2566] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:08 2022] PUT /identity/v3/projects/0b8348f4bffd44e7b0da6367a1011709/users/fe1f5f6882eb4a9aa869ad32fbdb0d92/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:08.843778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464319-c651-43e5-9211-73b6856411fc None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.844075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464319-c651-43e5-9211-73b6856411fc None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.844485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4464319-c651-43e5-9211-73b6856411fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:08.866039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d4464319-c651-43e5-9211-73b6856411fc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:08.867226 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d4464319-c651-43e5-9211-73b6856411fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.924579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1280/2567] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:08.934952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:08.936760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:08.992965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e7b7b-0649-4504-bf69-952eea60ab05 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:08.997574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:08.998219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:08.998512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:08.998792 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:09.008334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:09.009823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:09.019343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1288/2568] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:12.881746 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:12.882234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:12.882333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:12.908473 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] MFA Rules not processed for user `fe1f5f6882eb4a9aa869ad32fbdb0d92`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:12.909668 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:12.976364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1281/2569] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:12.981651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:12.991168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36830e-087e-45d0-bd48-911712d7456d service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:12.995878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:12.996524 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:12.996807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:12.997283 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:12.997978 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:12.999880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.033431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1289/2570] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:12 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:13.037671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:13.050030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48800b-6e90-4dcb-a32c-3900457d8f56 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:13.108084 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:13.108797 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:13.109081 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:13.109359 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:13.110057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:13.112006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.134468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1282/2571] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:13 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:13.135591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:13.147386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e7104-49bb-43be-aeac-c17a1c6074b6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:13.152724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:13.153407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:13.153684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:13.154141 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:13.154880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:13.156521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.171695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1290/2572] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:13.176614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:13.204019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ae60-3279-43aa-986f-a965c0ed7d06 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:13.209165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:13.210043 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:13.210326 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:13.210597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] PATH_INFO: `/v3/projects/5948d924e03b469c9368aeed17dd6ce3/users/dc1a006afd24478ca2269d84f0ab38bf/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:13.229347 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5948d924e03b469c9368aeed17dd6ce3, user_id=dc1a006afd24478ca2269d84f0ab38bf, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:13.232207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.253384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1283/2573] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:13 2022] PUT /identity/v3/projects/5948d924e03b469c9368aeed17dd6ce3/users/dc1a006afd24478ca2269d84f0ab38bf/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:13.257460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:13.268289 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9b6d1-3fd7-46f0-a819-46670e750c01 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:13.334695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:13.335491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:13.335836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:13.336179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:13.337005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:13.338665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641d13f-e6b0-480c-ae56-7c49be7efb58 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.349821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1291/2574] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:13.353957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:13.365146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a3ba-fe54-4792-a3b8-96a49018e46c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:13.369871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:13.370805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:13.371103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:13.371357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] PATH_INFO: `/v3/projects/5948d924e03b469c9368aeed17dd6ce3/users/dc1a006afd24478ca2269d84f0ab38bf/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:13.373458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5948d924e03b469c9368aeed17dd6ce3, user_id=dc1a006afd24478ca2269d84f0ab38bf, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:13.376105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:13.387910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1284/2575] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:13 2022] PUT /identity/v3/projects/5948d924e03b469c9368aeed17dd6ce3/users/dc1a006afd24478ca2269d84f0ab38bf/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:18.157043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:18.157969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:18.157969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:18.188372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] MFA Rules not processed for user `dc1a006afd24478ca2269d84f0ab38bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:18.189639 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:18.260164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1292/2576] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:55:18.274738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:18.276439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:18.351109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc64f8-c80f-4d18-b16e-3bbc91d7bb61 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:18.358238 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:18.358885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:18.359165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:18.359437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:18.414135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:18.415724 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baec2f7-2179-462d-8ff1-204674a06778 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:18.426729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1285/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:55:31.544411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:31.597925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2292935-1485-4dad-a2b0-3553a64c9056 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:31.602009 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:31.602715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:31.602921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:31.603243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:31.605008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:31.669030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:31.670479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:31.680304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1293/2578] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:34.713216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:34.713713 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:34.713809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:34.735778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] MFA Rules not processed for user `fe1f5f6882eb4a9aa869ad32fbdb0d92`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:34.736974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:34.744211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1286/2579] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:35.054492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.056495 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:35.070542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862e9a-0a8c-4714-b51f-6f9e08ff56d3 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.077919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.078997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.079438 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.080024 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] PATH_INFO: `/v3/users/25229d5ef3be47988accfdee5f9209b8` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.082185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25229d5ef3be47988accfdee5f9209b8)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.084354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.140218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25229d5ef3be47988accfdee5f9209b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.151545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25229d5ef3be47988accfdee5f9209b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.152844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25229d5ef3be47988accfdee5f9209b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.153478 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25229d5ef3be47988accfdee5f9209b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.163903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-7442c1b7-042c-46b0-bc0d-37e5413f4226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25229d5ef3be47988accfdee5f9209b8'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.177207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1294/2580] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:35 2022] DELETE /identity/v3/users/25229d5ef3be47988accfdee5f9209b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:35.408400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.422886 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61730c7d-4d2a-49cd-bb53-5678ba562fb2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.482930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.483868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.484220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.484602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] PATH_INFO: `/v3/projects/a26f2126d1804c3caf0f83a1eb47fbff` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.486109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26f2126d1804c3caf0f83a1eb47fbff)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.488080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.537461 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26f2126d1804c3caf0f83a1eb47fbff', 'request_id': 'req-35866270-8fb8-498f-a484-ffa32574d4bd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.544137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26f2126d1804c3caf0f83a1eb47fbff', 'request_id': 'req-35866270-8fb8-498f-a484-ffa32574d4bd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.551943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26f2126d1804c3caf0f83a1eb47fbff', 'request_id': 'req-35866270-8fb8-498f-a484-ffa32574d4bd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.564619 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] The token cache is being invalidate because project a26f2126d1804c3caf0f83a1eb47fbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:35.564914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.565540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-35866270-8fb8-498f-a484-ffa32574d4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:35.567171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1287/2581] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:35 2022] DELETE /identity/v3/projects/a26f2126d1804c3caf0f83a1eb47fbff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:35.572080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.572397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.572669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.593574 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:35.594771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:35.666782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1295/2582] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:35.675328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.675694 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.676042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.702947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:35.704261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:35.718237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1288/2583] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:55:35.731712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.733555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb050fc2-57a4-4050-8d7c-7807616b7a7c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.738145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.738814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.739220 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.739501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.740219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:35.740766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.742185 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.754074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1296/2584] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 16:55:35.758398 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.768506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a9fd7-671e-4245-91c4-be75fd976fb0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.773928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.774648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.774998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.775342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.776105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.778597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.806730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1289/2585] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:35 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:35.811659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.822722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f14ac-bf8e-485c-b153-6cbe10281fba admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.881100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.881775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.882062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.882339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.883023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.885112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.907023 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1297/2586] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:35 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:35.911148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.921602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28909241-87e8-4c4f-93d4-0911b83fc96d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.927113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.927775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.928057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.928367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.929090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.930701 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.943151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1290/2587] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:35.946812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:35.962463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4fa8-db7f-4598-a276-040010b21575 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:35.968341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:35.969021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:35.969308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:35.969590 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:35.970350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:35.971965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f91de5-fbcc-4c55-a075-7dc38677d69b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:35.983156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1298/2588] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:35.987578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:36.004812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba6a39-195a-4dc8-bc25-f9c685412560 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:36.010109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:36.011239 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.011676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.011968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] PATH_INFO: `/v3/projects/c89b254235214dd9b03b15dc50e3960c/users/4d1852e813a94512b41e0bae8cbc57d4/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.028679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89b254235214dd9b03b15dc50e3960c, user_id=4d1852e813a94512b41e0bae8cbc57d4, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:36.031367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:36.044693 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1291/2589] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:35 2022] PUT /identity/v3/projects/c89b254235214dd9b03b15dc50e3960c/users/4d1852e813a94512b41e0bae8cbc57d4/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:36.056834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.057400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.057400 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.084764 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] MFA Rules not processed for user `4d1852e813a94512b41e0bae8cbc57d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:36.085969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:36.150073 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1299/2590] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:36.162003 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:36.163342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:36.240323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaf3b3-64b6-4c60-98a9-7235da9355f8 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:36.245822 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:36.246655 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.246945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.247227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.255172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:36.256805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04966e29-6127-4175-bce6-47070087c9b3 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:36.266625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1292/2591] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:36.476682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:36.544697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe55a-8af7-4c01-9a69-c13c8e92fe07 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:36.549356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:36.550232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.550517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.550794 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] PATH_INFO: `/v3/users/4d1852e813a94512b41e0bae8cbc57d4` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.551970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1852e813a94512b41e0bae8cbc57d4)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:36.554072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:36.614638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1852e813a94512b41e0bae8cbc57d4'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:36.631461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1852e813a94512b41e0bae8cbc57d4'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:36.632206 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1852e813a94512b41e0bae8cbc57d4'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:36.632857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1852e813a94512b41e0bae8cbc57d4'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:36.641980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1852e813a94512b41e0bae8cbc57d4'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:36.658010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1300/2592] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:36 2022] DELETE /identity/v3/users/4d1852e813a94512b41e0bae8cbc57d4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:55:36.663073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.663368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.663676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.682660 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:36.684858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:36.749969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1293/2593] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:36.760460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:36.762565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:36.821838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80f47d-a296-4d35-bc6a-76ac283113e6 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:36.826111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:36.826758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:36.827040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:36.827311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:36.836606 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:36.838037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c69b-fd05-42e0-8cd0-c2e06890e0e2 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:36.851780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1301/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:37.257516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.259029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:37.271839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c41955-7b51-439c-9645-c6f80eed3c15 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.278176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.279606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.280059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.280485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] PATH_INFO: `/v3/projects/c89b254235214dd9b03b15dc50e3960c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.281894 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89b254235214dd9b03b15dc50e3960c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.284211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.342796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89b254235214dd9b03b15dc50e3960c', 'request_id': 'req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:37.348955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89b254235214dd9b03b15dc50e3960c', 'request_id': 'req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:37.357764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89b254235214dd9b03b15dc50e3960c', 'request_id': 'req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:37.368329 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] The token cache is being invalidate because project c89b254235214dd9b03b15dc50e3960c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:37.368625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:37.369891 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d3cca5d0-3a8f-4ad0-a37f-0ecd1f759d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:37.373448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1294/2595] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:37 2022] DELETE /identity/v3/projects/c89b254235214dd9b03b15dc50e3960c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:37.378538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.378974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.379113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.400691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:37.402455 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:37.470718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1302/2596] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:37.478873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.479166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.479452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.502969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:37.504666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:37.515287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1295/2597] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:37.519340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.530800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d881c30-29bb-465d-b06c-c6d4021b30fc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.538275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.539464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.539924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.540418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.541171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:37.541481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.543380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.569729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1303/2598] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:37.575683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.586308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3727cf-2135-4941-868e-6bbab18529b4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.591666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.592627 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.592985 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.593334 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.594103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.596916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.629613 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1296/2599] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:37.634186 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.645218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e5cdd-9400-4384-b8f5-bda04e0dffa4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.704358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.705038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.705318 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.705595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.706302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.708239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.728164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1304/2600] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:37.733196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.743242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d2ac2-65f7-41da-ade8-79387dd49ed7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.748597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.749252 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.749533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.749808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.750547 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.752144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.762517 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1297/2601] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:55:37.766593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.776144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d16fb-6ad1-4d1e-b105-221f34170394 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.781646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.782304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.782584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.782858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.783582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.785214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c117d-028f-48aa-83f9-ce3679dd4c5e admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.796064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1305/2602] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:55:37.800703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:37.811686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5dc66-d31a-4de8-bf80-7d2f50699005 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:37.816293 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:37.817182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.817513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.817828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] PATH_INFO: `/v3/projects/bbbd14c00c1b4923bb1abc2f55dd82ed/users/ae0d156b29854804b566a9be082c48ec/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.834107 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbd14c00c1b4923bb1abc2f55dd82ed, user_id=ae0d156b29854804b566a9be082c48ec, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:37.836751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:37.850579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1298/2603] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:37 2022] PUT /identity/v3/projects/bbbd14c00c1b4923bb1abc2f55dd82ed/users/ae0d156b29854804b566a9be082c48ec/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:37.863497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:37.863828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:37.864135 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:37.893728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] MFA Rules not processed for user `ae0d156b29854804b566a9be082c48ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:37.895081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:37.976454 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1306/2604] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:37.977425 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.070193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fdb7e-df53-404d-a547-99b3f40083db admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.082343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.083034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.083333 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.083596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.084379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.086452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.123828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1299/2605] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:37 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:38.128376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.141504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8c22-4f58-4c60-8f2e-7b051887ae03 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.204772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.205390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.205702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.205946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.206866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.209001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.238673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1307/2606] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:38 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:38.240390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.253307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e5d66-c738-4022-a0b4-cc08fad9d24b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.258021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.258679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.258960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.259231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.260076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.262462 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.273926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1300/2607] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:38.278838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.289951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed5858-47a2-484b-bc4b-055e12a61ff3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.295726 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.296706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.296996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.297276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] PATH_INFO: `/v3/projects/ac64d2bc57c340f59d795358189445f0/users/8a049537cca342fb86efcaf212cca409/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.313396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64d2bc57c340f59d795358189445f0, user_id=8a049537cca342fb86efcaf212cca409, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.316101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.329057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1308/2608] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:38 2022] PUT /identity/v3/projects/ac64d2bc57c340f59d795358189445f0/users/8a049537cca342fb86efcaf212cca409/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:55:38.333311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.346195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d066e00-5f4d-4817-81d3-fb7af7baa758 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.425156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.425826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.426109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.426385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.427194 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.429125 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3be3a-435e-426e-8156-e81f4795f87e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.440175 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1301/2609] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:55:38.448035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.468064 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69eda1-11c6-4e7a-a083-3b0afa89c8bc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.473992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.474847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.475117 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.475411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] PATH_INFO: `/v3/projects/ac64d2bc57c340f59d795358189445f0/users/8a049537cca342fb86efcaf212cca409/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.477443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64d2bc57c340f59d795358189445f0, user_id=8a049537cca342fb86efcaf212cca409, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.481021 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.492857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1309/2610] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:38 2022] PUT /identity/v3/projects/ac64d2bc57c340f59d795358189445f0/users/8a049537cca342fb86efcaf212cca409/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:38.503617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.506408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.506759 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.552337 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] MFA Rules not processed for user `8a049537cca342fb86efcaf212cca409`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:38.553577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:38.648794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1302/2611] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:38.680171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.681929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:38.753853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e420-d6cd-470c-8b40-d33c8d4923ac admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.757762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.758413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.758810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.759165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.769448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.770897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180474b-4f40-4ab0-be62-01f5cd4ed7c2 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.781056 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1310/2612] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:38.874925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:38.876818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:38.889365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876fd95-5559-4f7c-b206-17998c34add4 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:38.893537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:38.894154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:38.894981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:38.894981 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:38.963419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:38.965521 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:38.975289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1303/2613] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:40.491128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfb3c-4cb5-4dca-86bc-50198e1689cd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:40.491642 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfb3c-4cb5-4dca-86bc-50198e1689cd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:40.491739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcfb3c-4cb5-4dca-86bc-50198e1689cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:40.513837 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-04fcfb3c-4cb5-4dca-86bc-50198e1689cd None None] MFA Rules not processed for user `69585611ca7547adb43378445b4f1521`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:40.515190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-04fcfb3c-4cb5-4dca-86bc-50198e1689cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:40.591358 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1311/2614] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:48.224027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:48.285397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457862-2428-4ff1-817e-071aa3bda055 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:48.289961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:48.290825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:48.291108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:48.291385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] PATH_INFO: `/v3/users/ae0d156b29854804b566a9be082c48ec` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:48.293271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0d156b29854804b566a9be082c48ec)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:48.295278 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:48.343513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0d156b29854804b566a9be082c48ec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.355390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0d156b29854804b566a9be082c48ec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.356055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0d156b29854804b566a9be082c48ec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.356689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0d156b29854804b566a9be082c48ec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.363171 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0d156b29854804b566a9be082c48ec'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.376875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1304/2615] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:48 2022] DELETE /identity/v3/users/ae0d156b29854804b566a9be082c48ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:48.381310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:48.381805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:48.381913 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:48.398633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:48.399804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:48.455848 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1312/2616] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:48.465397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:48.466796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:48.521368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd2969-0449-43ea-b1b5-8b2e8af1f54b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:48.524988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:48.525621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:48.525903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:48.526216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:48.535097 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:48.536616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:48.546419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1305/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:48.899905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:48.902010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:48.926137 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd1193-6e74-4481-9756-72f40f346675 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:48.930940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:48.931791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:48.932071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:48.932897 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] PATH_INFO: `/v3/projects/bbbd14c00c1b4923bb1abc2f55dd82ed` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:48.934087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbd14c00c1b4923bb1abc2f55dd82ed)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:48.935998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:48.983390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbd14c00c1b4923bb1abc2f55dd82ed', 'request_id': 'req-2d4277d1-575e-47ca-8e45-a490bca6589f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.989695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbd14c00c1b4923bb1abc2f55dd82ed', 'request_id': 'req-2d4277d1-575e-47ca-8e45-a490bca6589f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:48.998376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbd14c00c1b4923bb1abc2f55dd82ed', 'request_id': 'req-2d4277d1-575e-47ca-8e45-a490bca6589f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.009632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] The token cache is being invalidate because project bbbd14c00c1b4923bb1abc2f55dd82ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:49.010267 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.011173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.015927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1313/2618] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:48 2022] DELETE /identity/v3/projects/bbbd14c00c1b4923bb1abc2f55dd82ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:49.017917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:49.027991 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40d75d-02c2-4902-88b3-5bce87e09399 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:49.087945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:49.088995 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.089291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.089556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] PATH_INFO: `/v3/users/8a049537cca342fb86efcaf212cca409` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.090750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a049537cca342fb86efcaf212cca409)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:49.092714 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:49.139586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a049537cca342fb86efcaf212cca409'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.150883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a049537cca342fb86efcaf212cca409'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.151684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a049537cca342fb86efcaf212cca409'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.152419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a049537cca342fb86efcaf212cca409'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.159166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-514d6092-0cbc-4f6e-95e8-2392ad115498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a049537cca342fb86efcaf212cca409'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.172634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1306/2619] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:49 2022] DELETE /identity/v3/users/8a049537cca342fb86efcaf212cca409 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:49.497881 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:49.500599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:49.516973 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4277d1-575e-47ca-8e45-a490bca6589f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:49.587704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:49.589188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.589505 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.589780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] PATH_INFO: `/v3/projects/ac64d2bc57c340f59d795358189445f0` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.591109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac64d2bc57c340f59d795358189445f0)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:49.593090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:49.638796 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac64d2bc57c340f59d795358189445f0', 'request_id': 'req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.644782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac64d2bc57c340f59d795358189445f0', 'request_id': 'req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.652445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac64d2bc57c340f59d795358189445f0', 'request_id': 'req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.662447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] The token cache is being invalidate because project ac64d2bc57c340f59d795358189445f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:49.662732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.663341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-82c2f18a-30d8-4ae4-b9d6-3b34783230c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:49.664910 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1314/2620] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:49 2022] DELETE /identity/v3/projects/ac64d2bc57c340f59d795358189445f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:49.670598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.671096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.671189 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.690665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:49.691864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:49.751392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1307/2621] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:49.759275 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.759636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.759923 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.779134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:49.780440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:49.788447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1315/2622] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:49.792962 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:49.802838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb862-0abe-4d57-b5e9-b79c5b02639c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:49.807447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:49.808458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.808749 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.809030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.809757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:49.810068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:49.811666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:49.823454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1308/2623] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:49.827712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:49.836790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d0be6-aace-4f70-8ace-14494c5778d5 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:49.842075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:49.842712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.842996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.843272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.843958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:49.845896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:49.869832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1316/2624] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:49 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:49.873898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:49.883600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c09c9-ad80-41d4-9189-8e1d2f811760 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:49.952867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:49.953556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:49.953842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:49.954230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:49.954940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:49.956898 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:49.989707 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1309/2625] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:49 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:49.990965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.001731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb8d91-5f15-4302-ad8b-30be78acdbc7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.006415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.007083 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.007371 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.007653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.008412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.010036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.021982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1317/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:50.026829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.036873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ade91-c21e-42f9-b54e-aff899780677 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.041578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.042246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.042532 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.042836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.043597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.045237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9fbd0-c113-4858-82be-1270069e3706 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.055529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1310/2627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:50.060239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.070165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6875-597f-4c15-a513-b9a9d73bcfd5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.075470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.076383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.076666 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.076940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] PATH_INFO: `/v3/projects/70dc0a62831849e7a69aa7ca7590a999/users/6376d62b575146828cec2bc7563e3732/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.091728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dc0a62831849e7a69aa7ca7590a999, user_id=6376d62b575146828cec2bc7563e3732, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.094393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.107646 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1318/2628] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:50 2022] PUT /identity/v3/projects/70dc0a62831849e7a69aa7ca7590a999/users/6376d62b575146828cec2bc7563e3732/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:55:50.119005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.119300 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.119586 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.147783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] MFA Rules not processed for user `6376d62b575146828cec2bc7563e3732`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:50.149023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:50.213177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1311/2629] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:50.218256 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.277849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d138-a781-4286-bba9-abdc667805d0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.282528 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.283193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.283473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.283775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.284500 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.286410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.313783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1319/2630] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:50 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:50.317823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.329665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f124cf-dc46-4c43-b4c4-73f8fb7c12e0 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.384711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.386284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.386929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.387208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.387937 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.389902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.413166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1312/2631] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:50 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:50.414626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.425309 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deda2e3-443d-4911-a777-c48023c54687 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.430299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.430956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.431230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.431504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.432223 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.434431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.445121 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1320/2632] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:50.450867 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.461076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e577e7-a869-492a-90b9-fa0f439220bb admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.467257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.468233 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.468632 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.468916 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] PATH_INFO: `/v3/projects/af7d83b679aa450d929c084c900c0330/users/0d432501f4b1446bbfc84561a9c18a1c/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.493933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7d83b679aa450d929c084c900c0330, user_id=0d432501f4b1446bbfc84561a9c18a1c, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.497591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.513636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1313/2633] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:50 2022] PUT /identity/v3/projects/af7d83b679aa450d929c084c900c0330/users/0d432501f4b1446bbfc84561a9c18a1c/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:50.518037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.529865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7cd59-0211-466b-a2b9-fcf9f34cd197 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.595960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.596592 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.596875 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.597158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.597886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.599489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c343fca-5702-49a0-a3a1-a21228c88c4f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.609253 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1321/2634] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:55:50.613448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.624933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424561-ae91-4000-9dcd-406021172fad admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.629563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.630428 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.630708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.630979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] PATH_INFO: `/v3/projects/af7d83b679aa450d929c084c900c0330/users/0d432501f4b1446bbfc84561a9c18a1c/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.632942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7d83b679aa450d929c084c900c0330, user_id=0d432501f4b1446bbfc84561a9c18a1c, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.636085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.646942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1314/2635] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:50 2022] PUT /identity/v3/projects/af7d83b679aa450d929c084c900c0330/users/0d432501f4b1446bbfc84561a9c18a1c/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:50.657751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.658042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.658322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.684663 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] MFA Rules not processed for user `0d432501f4b1446bbfc84561a9c18a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:50.686066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:50.752595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1322/2636] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:50.765883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:50.767596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:50.824516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dd37b-6440-45db-b120-72047f94d719 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:50.828255 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:50.828932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:50.829216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:50.829489 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:50.840642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:50.842191 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:50.852178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1315/2637] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:51.178326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.188622 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d21415-dbd4-4537-9b43-48b1ee394437 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.193467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d432501f4b1446bbfc84561a9c18a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7d83b679aa450d929c084c900c0330', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.194125 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.194414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.194696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.195497 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:51.195813 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.197575 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.212306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1323/2638] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:51.214754 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.223760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214312-26ed-4dc1-9874-29e378dc2ea4 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.228342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d432501f4b1446bbfc84561a9c18a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7d83b679aa450d929c084c900c0330', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.228996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.229794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.230078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.230885 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.232815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.259091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1316/2639] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:51 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:51.263134 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.273207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55936b-0315-4560-ac72-87f9653f078f tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.336808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d432501f4b1446bbfc84561a9c18a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7d83b679aa450d929c084c900c0330', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.337583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.337948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.338409 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.339734 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:51.340128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.342769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.354114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1324/2640] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:51.395348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.406757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527f3a0-ba82-4410-9439-f348901ba4d5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.412621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d432501f4b1446bbfc84561a9c18a1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af7d83b679aa450d929c084c900c0330', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.413582 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.413934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.414275 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] PATH_INFO: `/v3/projects/4668e323df9e4db3b3a49b77486d1667` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.415475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4668e323df9e4db3b3a49b77486d1667)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.418853 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.453777 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.455529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:51.472585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4668e323df9e4db3b3a49b77486d1667', 'request_id': 'req-c783610a-5628-4c28-9d0c-fbba0e79f135'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.479882 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4668e323df9e4db3b3a49b77486d1667', 'request_id': 'req-c783610a-5628-4c28-9d0c-fbba0e79f135'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.493497 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4668e323df9e4db3b3a49b77486d1667', 'request_id': 'req-c783610a-5628-4c28-9d0c-fbba0e79f135'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.507901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] The token cache is being invalidate because project 4668e323df9e4db3b3a49b77486d1667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:51.508198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.509102 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.511583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1317/2641] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:51 2022] DELETE /identity/v3/projects/4668e323df9e4db3b3a49b77486d1667 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:51.531389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d8cff-20e4-4f6d-94b9-ed110d3e1ec5 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.591264 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.592032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.592349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.592635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.594864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:51.681144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.683808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72059fc-2573-47c5-a50e-24d984491ba2 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.695759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1325/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:51.727703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.729283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:51.797823 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783610a-5628-4c28-9d0c-fbba0e79f135 tempest-VolumeQuotaClassesTest-2105792497 tempest-VolumeQuotaClassesTest-2105792497-project-admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:51.802633 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:51.803509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.803824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.804246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] PATH_INFO: `/v3/users/6376d62b575146828cec2bc7563e3732` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.805454 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6376d62b575146828cec2bc7563e3732)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:51.807922 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:51.854156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6376d62b575146828cec2bc7563e3732'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.866155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6376d62b575146828cec2bc7563e3732'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.867169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6376d62b575146828cec2bc7563e3732'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.867777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6376d62b575146828cec2bc7563e3732'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.875384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6376d62b575146828cec2bc7563e3732'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:51.889116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1318/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:51 2022] DELETE /identity/v3/users/6376d62b575146828cec2bc7563e3732 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:51.893703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:51.893998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:51.894278 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:51.911529 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:51.912696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:51.976033 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1326/2644] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:51.989067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:51.990721 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:52.048781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf45e8-2442-4b5f-b2fc-59550a11e72e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:52.052766 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:52.053410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:52.053697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:52.053972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:52.064711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:52.066161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:52.076765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1319/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:52.379629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:52.381116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:52.400241 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229c42d-9cec-4151-b717-6549c70d38d4 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:52.406494 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:52.407381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:52.407665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:52.407944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] PATH_INFO: `/v3/projects/70dc0a62831849e7a69aa7ca7590a999` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:52.409234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dc0a62831849e7a69aa7ca7590a999)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:52.411207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:52.462426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dc0a62831849e7a69aa7ca7590a999', 'request_id': 'req-96c13787-29ef-4dcc-b923-b35fec25b662'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.469907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dc0a62831849e7a69aa7ca7590a999', 'request_id': 'req-96c13787-29ef-4dcc-b923-b35fec25b662'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.477892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dc0a62831849e7a69aa7ca7590a999', 'request_id': 'req-96c13787-29ef-4dcc-b923-b35fec25b662'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.489864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] The token cache is being invalidate because project 70dc0a62831849e7a69aa7ca7590a999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:52.490144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.490795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.493379 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1327/2646] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:52 2022] DELETE /identity/v3/projects/70dc0a62831849e7a69aa7ca7590a999 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:52.497392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:52.507544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429cca0-23c1-406c-82b5-b8c0dcfbbb7e service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:52.585379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:52.586257 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:52.586543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:52.586821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] PATH_INFO: `/v3/users/0d432501f4b1446bbfc84561a9c18a1c` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:52.587990 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d432501f4b1446bbfc84561a9c18a1c)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:52.590476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:52.637745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d432501f4b1446bbfc84561a9c18a1c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.648872 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d432501f4b1446bbfc84561a9c18a1c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.649630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d432501f4b1446bbfc84561a9c18a1c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.650230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d432501f4b1446bbfc84561a9c18a1c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.657040 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-14a1244f-3042-40b9-8edb-ef2f8e96a151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d432501f4b1446bbfc84561a9c18a1c'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:52.670683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1320/2647] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:52 2022] DELETE /identity/v3/users/0d432501f4b1446bbfc84561a9c18a1c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:53.051504 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.053247 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.069084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c13787-29ef-4dcc-b923-b35fec25b662 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.149091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.150619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.150619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.150619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] PATH_INFO: `/v3/projects/af7d83b679aa450d929c084c900c0330` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.153373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7d83b679aa450d929c084c900c0330)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.155901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.207924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7d83b679aa450d929c084c900c0330', 'request_id': 'req-6345da24-e7b7-4e98-a301-67de02711c3f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:53.218660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7d83b679aa450d929c084c900c0330', 'request_id': 'req-6345da24-e7b7-4e98-a301-67de02711c3f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:53.233556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7d83b679aa450d929c084c900c0330', 'request_id': 'req-6345da24-e7b7-4e98-a301-67de02711c3f'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:53.245751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] The token cache is being invalidate because project af7d83b679aa450d929c084c900c0330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:53.246175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:53.246908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-6345da24-e7b7-4e98-a301-67de02711c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:53.248809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1328/2648] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:53 2022] DELETE /identity/v3/projects/af7d83b679aa450d929c084c900c0330 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:53.253684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.254195 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.254301 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.272049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:53.273288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.341952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1321/2649] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:53.349236 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.349521 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.349808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.369100 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:53.370579 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.379684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1329/2650] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:53.385512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.398149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ea44f-15cc-4343-ac1d-50930d2d9c85 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.405624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.406328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.406618 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.407550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.408340 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:55:53.409035 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.410944 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.428316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1322/2651] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:55:53.429891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.441091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d745f1-d682-4f07-a4f3-5911f7de08bd None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.445929 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.446738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.447026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.447300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.448506 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.451068 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.481410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1330/2652] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:53.485825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.495928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7109d9-60f2-4db1-8390-f5400c51d83b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.564875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.565554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.565968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.566299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.566994 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.569114 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.596684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1323/2653] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:53.600581 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.612659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0907-d936-49e8-8a09-fe1fc02977ee admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.617398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.618196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.618489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.618772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.619545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.621919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.634934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1331/2654] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:55:53.641603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.656966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254671b-8b7a-437a-a94f-9b11c06c895a admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.662512 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.663316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.663708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.664095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.664961 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.667375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ad09f-cd03-4435-a1cd-7683f065dacb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.678429 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1324/2655] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:53.683106 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.701183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547f480-0787-46f8-96c8-ad1753ef54a5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.706308 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.707204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.707492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.707774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] PATH_INFO: `/v3/projects/2f7f281e8eae433a9f620e69b28bdf54/users/1c635a3e95ae4a479d70e5bf67194a74/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.726179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7f281e8eae433a9f620e69b28bdf54, user_id=1c635a3e95ae4a479d70e5bf67194a74, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.732847 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.764086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1332/2656] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:53 2022] PUT /identity/v3/projects/2f7f281e8eae433a9f620e69b28bdf54/users/1c635a3e95ae4a479d70e5bf67194a74/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:53.766542 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.767046 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.767498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.785324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.787356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.807516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] MFA Rules not processed for user `1c635a3e95ae4a479d70e5bf67194a74`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:53.809531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.895503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1325/2657] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:53.899915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:53.900415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7f5cc-f2dc-408b-b4b3-51b3825c8a80 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:53.913729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:53.914480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:53.914838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:53.915195 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:53.918238 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:53.937031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:53.938800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:53.964697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1333/2658] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:53.997883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a6671-5631-4062-9474-5f0519807aa7 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.002596 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.003276 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.003561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.003839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.004579 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.006538 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.040978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1326/2659] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:53 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:54.044866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.056081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc233f-010c-4bef-828c-beefafefdcac service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.126163 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.127030 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.127342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.127701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.128609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.132562 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.164193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1334/2660] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:54 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:54.165757 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.176760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfa3e4-5372-4ce2-b516-3035cc5116e9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.181977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.183161 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.183440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.183941 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.184818 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.186457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.200230 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1327/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:54.204164 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.215190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae9c-40f3-4424-aad7-cc4bcef1f4b5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.220831 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.222081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.222081 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.222514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.223368 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.225301 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeab75-1e97-48c5-8b8f-d2e1c24a4357 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.237687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1335/2662] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:54.241825 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.252496 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f40ea-2ea3-49f3-a378-a724300c2b17 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.258063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.258953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.259241 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.259523 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] PATH_INFO: `/v3/projects/3e45f56823124e38a5e7985f8bad0473/users/f0b216156c054a94b073e19198b1d3b9/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.276883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e45f56823124e38a5e7985f8bad0473, user_id=f0b216156c054a94b073e19198b1d3b9, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.282196 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.304711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1328/2663] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:54 2022] PUT /identity/v3/projects/3e45f56823124e38a5e7985f8bad0473/users/f0b216156c054a94b073e19198b1d3b9/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:55:54.315774 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.316460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.316948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.346880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] MFA Rules not processed for user `f0b216156c054a94b073e19198b1d3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:54.348263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:54.421768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1336/2664] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:54.426726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.500686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea4cbd-9d39-49ea-b1f7-36b202c0d0cd admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.505396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.506419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.506788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.507078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.507795 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.509777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.546591 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1329/2665] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:55:54 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:55:54.549412 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.562936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaeb196-a9f4-4299-ad24-6a2737aee86c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.638342 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.639435 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.639795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.640138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.640961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.643388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.674850 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1337/2666] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:55:54 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:55:54.679184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.692712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b150dec-1083-40fa-8c26-b5baed3e7a9c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.700419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.701507 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.701899 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.702349 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.703237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.706140 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.722952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1330/2667] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:54.727120 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.741643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd684728-e38d-4ba9-aec0-ad01b9add651 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.748669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.749659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.750005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.750350 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] PATH_INFO: `/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86/users/0d605b5f9a6045bebdd21e9e2e93a78b/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.767728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8bfdaeb6e14ed2a63591fd719fdf86, user_id=0d605b5f9a6045bebdd21e9e2e93a78b, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.772028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.799716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1338/2668] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:54 2022] PUT /identity/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86/users/0d605b5f9a6045bebdd21e9e2e93a78b/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:54.801733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.816176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65985a7-3605-4e3d-8cfd-79cbf8cf568b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.889846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.890940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.891330 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.891988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.892875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.894722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b025424-4569-4613-93de-03af90d1a76c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.909225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1331/2669] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:55:54.910724 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:54.927610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e120b78-8aab-4e12-bdc1-3a31c4ba00c1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:54.938158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:54.939992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.945938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.946266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] PATH_INFO: `/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86/users/0d605b5f9a6045bebdd21e9e2e93a78b/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:54.952882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8bfdaeb6e14ed2a63591fd719fdf86, user_id=0d605b5f9a6045bebdd21e9e2e93a78b, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:54.956924 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:54.983554 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1339/2670] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:55:54 2022] PUT /identity/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86/users/0d605b5f9a6045bebdd21e9e2e93a78b/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:54.985493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:54.985783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:54.986061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:55.016016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] MFA Rules not processed for user `0d605b5f9a6045bebdd21e9e2e93a78b`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:55.017717 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:55.109887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1332/2671] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:55.129096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:55.132377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:55.209227 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdde2f-d9f1-41bc-ab95-28f0047d32de admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:55.214722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:55.215452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:55.215819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:55.216207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:55.227224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:55.228935 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:55.242703 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1340/2672] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:55.287843 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:55.289397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:55.303847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b355b-ec33-4873-ae3c-9ad9e63d629b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:55.308104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:55.308804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:55.309078 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:55.309357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:55.371348 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:55.373037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2a1e4-890b-4801-8348-035a03c4f990 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:55.383274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1333/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:58.272587 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:58.332625 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5501ee-f5ec-48da-8cfc-e84c71260c11 service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:58.337156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:58.338017 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:58.338898 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:58.339260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] PATH_INFO: `/v3/users/1c635a3e95ae4a479d70e5bf67194a74` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:58.340687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c635a3e95ae4a479d70e5bf67194a74)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:58.342611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:58.387982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c635a3e95ae4a479d70e5bf67194a74'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.399062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c635a3e95ae4a479d70e5bf67194a74'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.399715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c635a3e95ae4a479d70e5bf67194a74'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.400348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c635a3e95ae4a479d70e5bf67194a74'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.406920 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c635a3e95ae4a479d70e5bf67194a74'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.419619 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1341/2674] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:58 2022] DELETE /identity/v3/users/1c635a3e95ae4a479d70e5bf67194a74 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:58.424439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:58.424930 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:58.425029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:58.443781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:55:58.445133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:58.502931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1334/2675] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:55:58.513700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:58.515087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:58.570357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4d5ab-f8e3-4adf-8b66-dace680156be admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:58.574909 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:58.575551 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:58.575832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:58.576105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:58.585343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:58.586766 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:58.595997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1342/2676] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:55:58.863286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:58.864752 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:58.879457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb18fd-5467-4f85-8027-a7280e9a691c None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:58.884387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:58.886289 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:58.886620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:58.887039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] PATH_INFO: `/v3/projects/2f7f281e8eae433a9f620e69b28bdf54` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:58.888157 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7f281e8eae433a9f620e69b28bdf54)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:58.890148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:58.938551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7f281e8eae433a9f620e69b28bdf54', 'request_id': 'req-5a64c004-0abe-436b-b341-6b8761caae43'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.944595 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7f281e8eae433a9f620e69b28bdf54', 'request_id': 'req-5a64c004-0abe-436b-b341-6b8761caae43'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.951996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7f281e8eae433a9f620e69b28bdf54', 'request_id': 'req-5a64c004-0abe-436b-b341-6b8761caae43'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.961925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] The token cache is being invalidate because project 2f7f281e8eae433a9f620e69b28bdf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:58.962214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.962835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:58.964977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1335/2677] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:58 2022] DELETE /identity/v3/projects/2f7f281e8eae433a9f620e69b28bdf54 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:58.968901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:58.978192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774e1d5-c57d-4eaf-8f69-db91cd61f2f3 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:59.034396 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:59.035179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:59.035469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:59.035742 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] PATH_INFO: `/v3/users/f0b216156c054a94b073e19198b1d3b9` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:59.037000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b216156c054a94b073e19198b1d3b9)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:59.038914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:59.085321 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b216156c054a94b073e19198b1d3b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.097337 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b216156c054a94b073e19198b1d3b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.097999 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b216156c054a94b073e19198b1d3b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.098598 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b216156c054a94b073e19198b1d3b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.105190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b216156c054a94b073e19198b1d3b9'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.117398 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1343/2678] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:58 2022] DELETE /identity/v3/users/f0b216156c054a94b073e19198b1d3b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:59.381883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:59.383374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:59.397868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c004-0abe-436b-b341-6b8761caae43 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:59.454315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:59.455169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:59.455452 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:59.455727 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] PATH_INFO: `/v3/projects/3e45f56823124e38a5e7985f8bad0473` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:59.456914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e45f56823124e38a5e7985f8bad0473)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:59.458812 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:59.505146 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e45f56823124e38a5e7985f8bad0473', 'request_id': 'req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.511803 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e45f56823124e38a5e7985f8bad0473', 'request_id': 'req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.519180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e45f56823124e38a5e7985f8bad0473', 'request_id': 'req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.529315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] The token cache is being invalidate because project 3e45f56823124e38a5e7985f8bad0473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:55:59.529600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.530220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.531784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1336/2679] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:59 2022] DELETE /identity/v3/projects/3e45f56823124e38a5e7985f8bad0473 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:59.536154 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:59.537599 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:55:59.551268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689dc64-7060-4fa9-a17d-0584dc0bca90 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:55:59.608145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:55:59.609194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:55:59.609502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:55:59.609783 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] PATH_INFO: `/v3/users/0d605b5f9a6045bebdd21e9e2e93a78b` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:55:59.611005 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d605b5f9a6045bebdd21e9e2e93a78b)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:55:59.612987 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:55:59.658527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d605b5f9a6045bebdd21e9e2e93a78b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.670679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d605b5f9a6045bebdd21e9e2e93a78b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.671385 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d605b5f9a6045bebdd21e9e2e93a78b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.672020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d605b5f9a6045bebdd21e9e2e93a78b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.680011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-02499e9c-4342-453b-bc5a-7ffebb7c5011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d605b5f9a6045bebdd21e9e2e93a78b'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:55:59.695653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1344/2680] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:55:59 2022] DELETE /identity/v3/users/0d605b5f9a6045bebdd21e9e2e93a78b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:55:59.985589 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:55:59.987225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:00.009248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a77f1-baea-475a-a2ce-1d3a0cb9acb2 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.076635 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.077503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.077792 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.078073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] PATH_INFO: `/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.079782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8bfdaeb6e14ed2a63591fd719fdf86)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.081407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.129384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8bfdaeb6e14ed2a63591fd719fdf86', 'request_id': 'req-733230c6-123e-4ae6-9adc-24397c471648'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:00.136038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8bfdaeb6e14ed2a63591fd719fdf86', 'request_id': 'req-733230c6-123e-4ae6-9adc-24397c471648'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:00.142712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8bfdaeb6e14ed2a63591fd719fdf86', 'request_id': 'req-733230c6-123e-4ae6-9adc-24397c471648'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:00.153799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] The token cache is being invalidate because project ff8bfdaeb6e14ed2a63591fd719fdf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:00.154088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:00.154722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-733230c6-123e-4ae6-9adc-24397c471648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:00.156264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1337/2681] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:55:59 2022] DELETE /identity/v3/projects/ff8bfdaeb6e14ed2a63591fd719fdf86 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:00.162191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.162479 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.162758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.180958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:00.182760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:00.252685 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1345/2682] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:00.261931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.262264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.262548 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.280931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:00.282136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:00.290031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1338/2683] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:00.294899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.304715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8b671-2c65-492d-914e-561fa9ab6164 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.310179 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.310824 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.311109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.311386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.312112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:56:00.312473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.314091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.325261 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1346/2684] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:56:00.329773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.339313 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3074443-6c7f-4ab7-aefa-4b34b2eab0ee None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.344070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.344745 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.345104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.345314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.345999 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.347901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.374181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1339/2685] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:00 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:00.378370 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.388617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39221a6-259e-4877-8c37-ee8ce73a0138 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.441976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.442632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.443022 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.443634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.444452 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.446375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.466002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1347/2686] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:00 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:00.470139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.481077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bde16-c462-4e42-806f-c352eb9f8db0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.485620 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.486260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.486569 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.486845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.487561 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.489176 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.499845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1340/2687] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:00.503896 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.514510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2d95d-1cee-4034-bb6e-822e30561622 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.519218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.519864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.520152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.520545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.521303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.522892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4cec8-2b76-4983-87d6-59ce419f4fac admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.533903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1348/2688] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 16:56:00.538283 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.548811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7017b3-6b96-4e30-bd95-ee152fc69962 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.553474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.554346 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.554626 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.554897 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] PATH_INFO: `/v3/projects/b5ec285d04c74e2794451f45cab4baf9/users/5137567523b34cf298b5538a0380d06d/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.570796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ec285d04c74e2794451f45cab4baf9, user_id=5137567523b34cf298b5538a0380d06d, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.574153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.586566 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1341/2689] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:00 2022] PUT /identity/v3/projects/b5ec285d04c74e2794451f45cab4baf9/users/5137567523b34cf298b5538a0380d06d/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:56:00.592339 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17950e-da73-45e2-b939-47dc6fd0d413 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.592793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17950e-da73-45e2-b939-47dc6fd0d413 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.592938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17950e-da73-45e2-b939-47dc6fd0d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.611469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-da17950e-da73-45e2-b939-47dc6fd0d413 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:00.612827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-da17950e-da73-45e2-b939-47dc6fd0d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:00.672224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1349/2690] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:00.682920 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:00.685159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:00.739933 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8dc18-b43f-400c-8de9-6058ba0af9bd admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:00.743491 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:00.744128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:00.744928 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:00.745319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:00.754149 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:00.755551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:00.765299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1342/2691] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:56:01.379008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.379407 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.379753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.406322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] MFA Rules not processed for user `5137567523b34cf298b5538a0380d06d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:01.407511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:01.471977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1350/2692] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:01.476781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.487209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440889d-b922-441b-83d8-aef37f3a3f8c service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.491739 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.492416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.492702 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.492979 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.493666 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.496076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.521553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1343/2693] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:01 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:56:01.525539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.541116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94304826-28b5-4867-990a-86a59ebd5a69 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.605683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.606340 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.606613 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.606889 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.607571 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.609578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.632311 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1351/2694] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:01 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:56:01.634159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.646363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0f121-625d-4c8b-9ecc-897c6d5726d1 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.651617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.652308 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.652592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.652864 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.653664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.655249 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.666048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1344/2695] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:01.670971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.681231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4813d-1cb7-42c9-a8f0-f40cc036b3a1 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.687727 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.688844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.689171 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.689508 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] PATH_INFO: `/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6/users/84677041955d499fa71d3933b806be05/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.705039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b176ad0bf8f34a59a8a25e1fe9da52d6, user_id=84677041955d499fa71d3933b806be05, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.707818 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.721168 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1352/2696] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:01 2022] PUT /identity/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6/users/84677041955d499fa71d3933b806be05/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:01.725141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.735077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ab247-0ab4-4d82-b475-02a91077fde5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.790482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.791058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.791403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.791683 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.792509 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.794095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.803674 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1345/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:01.807997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:01.818036 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee76b-296e-4ed1-8fc4-c6f8c1b3dd5b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:01.823061 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:01.824116 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:01.824429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:01.824706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] PATH_INFO: `/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6/users/84677041955d499fa71d3933b806be05/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:01.826674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b176ad0bf8f34a59a8a25e1fe9da52d6, user_id=84677041955d499fa71d3933b806be05, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:01.829354 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ccddc-a47b-4b1e-be38-054d02f783f4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:01.840198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1353/2698] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:01 2022] PUT /identity/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6/users/84677041955d499fa71d3933b806be05/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:02.375615 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:02.377254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:02.447293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:02.448557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:02.448849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:02.461153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd60170-4e38-429c-8085-429036f33ab0 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:02.476440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] MFA Rules not processed for user `84677041955d499fa71d3933b806be05`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:02.477673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:02.529060 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:02.529725 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:02.530010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:02.530288 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:02.532426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:02.545987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:02.548227 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:02.562526 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1354/2699] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:02.562737 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1346/2700] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:02.569880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:02.571348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:02.632891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844093-3233-4584-81bd-54f665dbd17a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:02.636974 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:02.637698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:02.638050 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:02.638643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:02.698060 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:02.699869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:02.709193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1355/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:04.047074 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:04.049691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:04.061264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e361-f216-43e5-ad39-6bc3c14de8c7 service placement] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:04.064860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:04.065506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:04.065791 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:04.066067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:04.075437 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:04.076914 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:04.086680 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1347/2702] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:16.907413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:16.970451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36932570-cea1-4af0-99e8-d14662bf95ba service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:16.974903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:16.975760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:16.976043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:16.976351 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] PATH_INFO: `/v3/users/5137567523b34cf298b5538a0380d06d` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:16.977520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5137567523b34cf298b5538a0380d06d)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:16.980049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:17.022760 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5137567523b34cf298b5538a0380d06d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.034682 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5137567523b34cf298b5538a0380d06d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.035355 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5137567523b34cf298b5538a0380d06d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.035962 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5137567523b34cf298b5538a0380d06d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.043263 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5137567523b34cf298b5538a0380d06d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.055931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1356/2703] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:16 2022] DELETE /identity/v3/users/5137567523b34cf298b5538a0380d06d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:17.225934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:17.237242 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd848f12-2b58-487d-8e1b-4ec21fa39ea1 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:17.294545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:17.295396 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.295678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.295953 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] PATH_INFO: `/v3/projects/b5ec285d04c74e2794451f45cab4baf9` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.297163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ec285d04c74e2794451f45cab4baf9)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:17.299321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:17.344736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ec285d04c74e2794451f45cab4baf9', 'request_id': 'req-d78fa845-aa80-4d7a-9c47-dd1f52996655'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.350609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ec285d04c74e2794451f45cab4baf9', 'request_id': 'req-d78fa845-aa80-4d7a-9c47-dd1f52996655'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.358220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ec285d04c74e2794451f45cab4baf9', 'request_id': 'req-d78fa845-aa80-4d7a-9c47-dd1f52996655'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.367839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] The token cache is being invalidate because project b5ec285d04c74e2794451f45cab4baf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:17.368121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.368777 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.370549 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1348/2704] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:17 2022] DELETE /identity/v3/projects/b5ec285d04c74e2794451f45cab4baf9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:17.374535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:17.375907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:17.389778 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98e3bf-c341-4df1-b3db-ba945a8ce763 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:17.443762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:17.444659 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.444944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.445222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] PATH_INFO: `/v3/users/84677041955d499fa71d3933b806be05` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.446390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84677041955d499fa71d3933b806be05)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:17.448986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:17.493300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84677041955d499fa71d3933b806be05'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.505380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84677041955d499fa71d3933b806be05'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.506043 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84677041955d499fa71d3933b806be05'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.506636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84677041955d499fa71d3933b806be05'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.513885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-cba07bf3-392d-486c-a7d6-c46a678fa26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84677041955d499fa71d3933b806be05'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.526086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1357/2705] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:17 2022] DELETE /identity/v3/users/84677041955d499fa71d3933b806be05 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:56:17.696417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:17.698563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:17.712099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa845-aa80-4d7a-9c47-dd1f52996655 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:17.769076 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:17.769924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.770200 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.770476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] PATH_INFO: `/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.771658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b176ad0bf8f34a59a8a25e1fe9da52d6)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:17.773599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:17.817649 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b176ad0bf8f34a59a8a25e1fe9da52d6', 'request_id': 'req-e27b444f-7357-4629-911b-ed18dfeb48b7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.824166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b176ad0bf8f34a59a8a25e1fe9da52d6', 'request_id': 'req-e27b444f-7357-4629-911b-ed18dfeb48b7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.831188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b176ad0bf8f34a59a8a25e1fe9da52d6', 'request_id': 'req-e27b444f-7357-4629-911b-ed18dfeb48b7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.840926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] The token cache is being invalidate because project b176ad0bf8f34a59a8a25e1fe9da52d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:17.841203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.841805 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e27b444f-7357-4629-911b-ed18dfeb48b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:17.843317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1349/2706] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:17 2022] DELETE /identity/v3/projects/b176ad0bf8f34a59a8a25e1fe9da52d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:17.848226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.848546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.848822 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.869670 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:17.871035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:17.928649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1358/2707] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:17.937087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.937376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.937685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.955443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:17.956663 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:17.964294 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1350/2708] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:17.968416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:17.977712 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257253f5-3d85-45f2-8854-b7fd5d4f7971 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:17.982916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:17.983569 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:17.983854 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:17.984132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:17.984894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:56:17.985203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:17.986795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:17.998693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1359/2709] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:56:18.003116 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.015553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8a506-27a7-46bd-80aa-2edd79d9c5a5 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.020352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.020960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.023908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.024198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.024983 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.027692 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.055287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1351/2710] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:56:18.060891 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.071643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd3cf8-2b8d-453b-90ac-8a615d632413 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.128129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.128838 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.129122 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.129397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.130084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.132097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.150975 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1360/2711] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:18.155094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.165061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49343a5-a472-4609-ad77-68e02a00af1e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.170186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.170850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.171112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.171385 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.172095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.173968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.184794 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1352/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:18.188752 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.199280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c19713-2638-4991-b8d6-20f1dae807fc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.203832 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.204512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.204815 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.205075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.205797 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.207383 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b049-17e1-48e2-9680-27d585813be5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.217097 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1361/2713] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:18.221096 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.232004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0854f-1b1f-4ce4-b32b-b9e637407c1d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.236696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.237565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.237851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.238131 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] PATH_INFO: `/v3/projects/0d27b68b6cee48ab846656801f141435/users/fa409e4dceba4570b349751c3bf45de7/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.253317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d27b68b6cee48ab846656801f141435, user_id=fa409e4dceba4570b349751c3bf45de7, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.255988 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.268565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1353/2714] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:18 2022] PUT /identity/v3/projects/0d27b68b6cee48ab846656801f141435/users/fa409e4dceba4570b349751c3bf45de7/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:56:18.282079 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.282317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.282623 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.311481 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] MFA Rules not processed for user `fa409e4dceba4570b349751c3bf45de7`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:18.312731 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:18.377037 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1362/2715] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:18.381685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.440865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa95d08-76ca-43ea-a023-5abb171542ab admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.445375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.446016 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.446297 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.446573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.447478 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.449321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.474376 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1354/2716] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:18.478992 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.489844 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb3abe-cd3b-43e5-bb0e-55b72991df54 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.543934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.544555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.544842 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.545119 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.545820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.547753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.567099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1363/2717] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:18.571138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.581696 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0fb2a-1f31-43bc-9212-cc960d4a9a9d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.586544 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.587209 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.587498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.588350 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.589377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.590982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.601447 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1355/2718] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:18.606143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.615968 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49133-67d3-4a4b-af20-b9ed4c06c2a3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.620841 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.621747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.622034 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.622312 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] PATH_INFO: `/v3/projects/4a38be9fbb654040b09fd84d9ff10750/users/afc38cecedbf47c8a0bc19f534e81518/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.637474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a38be9fbb654040b09fd84d9ff10750, user_id=afc38cecedbf47c8a0bc19f534e81518, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.640175 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.653305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1364/2719] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:18 2022] PUT /identity/v3/projects/4a38be9fbb654040b09fd84d9ff10750/users/afc38cecedbf47c8a0bc19f534e81518/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:18.657482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.668291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6446142-eb71-4a22-8717-5237c71326f9 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.725436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.726104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.726390 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.726669 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.727393 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.729251 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50cabc-42db-4882-b91b-bd3533971142 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.738807 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1356/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:18.742853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.752836 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808b08e-e865-4474-b72b-236fc22f51c7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.757463 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.758334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.758616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.758892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] PATH_INFO: `/v3/projects/4a38be9fbb654040b09fd84d9ff10750/users/afc38cecedbf47c8a0bc19f534e81518/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.761597 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a38be9fbb654040b09fd84d9ff10750, user_id=afc38cecedbf47c8a0bc19f534e81518, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:18.764227 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:18.774103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1365/2721] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:18 2022] PUT /identity/v3/projects/4a38be9fbb654040b09fd84d9ff10750/users/afc38cecedbf47c8a0bc19f534e81518/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:18.784881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.785173 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.785450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:18.811475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] MFA Rules not processed for user `afc38cecedbf47c8a0bc19f534e81518`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:18.812643 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:18.878873 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1357/2722] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:18.890989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:18.892789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:18.948608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9295c2-0780-4840-bf39-6062b3509ce0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:18.952254 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:18.952925 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:18.953208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:18.953487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:19.008048 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:19.010152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd05b6-36fb-4c1d-8678-efd0438acd10 service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:19.018853 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1366/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:21.524036 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:21.584049 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7aea5-1219-45dc-9a45-175935a942b3 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:21.589572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:21.590450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:21.590738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:21.591023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] PATH_INFO: `/v3/users/fa409e4dceba4570b349751c3bf45de7` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:21.592223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa409e4dceba4570b349751c3bf45de7)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:21.594389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:21.640265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa409e4dceba4570b349751c3bf45de7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:21.653260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa409e4dceba4570b349751c3bf45de7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:21.654261 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa409e4dceba4570b349751c3bf45de7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:21.654959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa409e4dceba4570b349751c3bf45de7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:21.662007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa409e4dceba4570b349751c3bf45de7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:21.674625 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1358/2724] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:21 2022] DELETE /identity/v3/users/fa409e4dceba4570b349751c3bf45de7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:21.679109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:21.679584 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:21.679691 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:21.697894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:21.699065 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:21.754433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1367/2725] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:56:21.765319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:21.766747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:21.823676 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0de0-6ad3-4ebd-8db6-96d47f0a5d13 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:21.827314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:21.827952 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:21.828237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:21.828543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:21.838374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:21.839799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:21.849540 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1359/2726] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:22.112772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:22.114208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:22.126304 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511e7f0-fbb8-4526-bf30-3f4b1efd73e9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:22.131828 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:22.132917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.133255 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.133539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] PATH_INFO: `/v3/projects/0d27b68b6cee48ab846656801f141435` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.135373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d27b68b6cee48ab846656801f141435)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:22.138252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:22.185280 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d27b68b6cee48ab846656801f141435', 'request_id': 'req-910161f1-8076-453b-8259-c8e5ec831b03'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.191429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d27b68b6cee48ab846656801f141435', 'request_id': 'req-910161f1-8076-453b-8259-c8e5ec831b03'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.198605 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d27b68b6cee48ab846656801f141435', 'request_id': 'req-910161f1-8076-453b-8259-c8e5ec831b03'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.208421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] The token cache is being invalidate because project 0d27b68b6cee48ab846656801f141435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:22.208711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.209324 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.210967 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1368/2727] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:22 2022] DELETE /identity/v3/projects/0d27b68b6cee48ab846656801f141435 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:22.215264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:22.225159 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fafc9-5e37-4f56-9eba-5e1a1e6372a1 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:22.281881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:22.282744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.283029 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.283306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] PATH_INFO: `/v3/users/afc38cecedbf47c8a0bc19f534e81518` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.284514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc38cecedbf47c8a0bc19f534e81518)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:22.286455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:22.332112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc38cecedbf47c8a0bc19f534e81518'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.344319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc38cecedbf47c8a0bc19f534e81518'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.345007 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc38cecedbf47c8a0bc19f534e81518'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.345624 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc38cecedbf47c8a0bc19f534e81518'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.352221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-4f84bc15-546f-40bf-bc11-2d2e51f77a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc38cecedbf47c8a0bc19f534e81518'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.366056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1360/2728] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:22 2022] DELETE /identity/v3/users/afc38cecedbf47c8a0bc19f534e81518 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:22.632260 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:22.634025 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:22.647941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910161f1-8076-453b-8259-c8e5ec831b03 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:22.708326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:22.709908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.710145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.710424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] PATH_INFO: `/v3/projects/4a38be9fbb654040b09fd84d9ff10750` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.711614 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a38be9fbb654040b09fd84d9ff10750)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:22.714303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:22.760533 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a38be9fbb654040b09fd84d9ff10750', 'request_id': 'req-2d3d7cae-8425-4953-9ff8-0d6c0575b329'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.766633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a38be9fbb654040b09fd84d9ff10750', 'request_id': 'req-2d3d7cae-8425-4953-9ff8-0d6c0575b329'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.773800 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a38be9fbb654040b09fd84d9ff10750', 'request_id': 'req-2d3d7cae-8425-4953-9ff8-0d6c0575b329'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.783901 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] The token cache is being invalidate because project 4a38be9fbb654040b09fd84d9ff10750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:22.784188 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.784870 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-2d3d7cae-8425-4953-9ff8-0d6c0575b329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:22.786405 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1369/2729] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:22 2022] DELETE /identity/v3/projects/4a38be9fbb654040b09fd84d9ff10750 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:22.791708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.792199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.792402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.809910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:22.811087 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:22.871038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1361/2730] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:56:22.879040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.879333 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.879617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.898577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:22.899771 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:22.908063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1370/2731] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:22.912387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:22.922731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19cf1d-f78a-4e06-946e-fdee4d96c7a2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:22.927488 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:22.928128 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.928448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.928729 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.929453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:56:22.929761 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:22.931833 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:22.943404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1362/2732] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:56:22.948293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:22.957322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77000f-9de0-4965-b42c-e1c6974f21fc None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:22.961998 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:22.962686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:22.962971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:22.963246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:22.963942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:22.965894 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:22.993221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1371/2733] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:22 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:22.994868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.004536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c68a8-6448-4500-9786-c51feed3f502 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.061186 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.061859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.062147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.062458 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.063147 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.065124 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.085259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1363/2734] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:22 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:23.090140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.100145 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc382fa6-3e26-4790-9cb0-d1d36abc00cc admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.105459 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.106113 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.106399 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.106675 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.107401 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.109041 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.120834 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1372/2735] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:23.124890 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.135151 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114565-b153-402e-8159-205c20bf915b admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.139751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.140443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.140731 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.141004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.141722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.143304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dea495-ac16-40c7-965f-1d272dfb6716 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.153180 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1364/2736] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:23.157165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.167991 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed05a7-d0ef-488b-9ba9-d733a0ed81b5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.173701 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.174577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.174865 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.175144 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] PATH_INFO: `/v3/projects/ad955de97b974289b5ce185e77108b63/users/39a4810919ef4136a51b9aa43dcba509/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.190879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad955de97b974289b5ce185e77108b63, user_id=39a4810919ef4136a51b9aa43dcba509, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.193559 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.206431 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1373/2737] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:23 2022] PUT /identity/v3/projects/ad955de97b974289b5ce185e77108b63/users/39a4810919ef4136a51b9aa43dcba509/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:23.271904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.272154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.272409 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.299904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] MFA Rules not processed for user `39a4810919ef4136a51b9aa43dcba509`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:23.301148 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:23.362656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1365/2738] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:23.367177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.437146 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fcf09-1bbe-41f8-af01-00896efe08f5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.442059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.442725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.443013 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.443291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.443996 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.445942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.473465 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1374/2739] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:23.477603 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.488906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90054f-ccfe-488b-8d9a-cead0fe265d2 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.544617 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.545212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.545500 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.545778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.546465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.548665 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.567634 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1366/2740] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:56:23.571651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.582651 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b83b9-3a97-4b8f-aa00-5bfaacd406b7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.587940 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.588826 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.589112 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.589386 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.590109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.591684 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.601951 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1375/2741] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:23.607006 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.617143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445185d6-f3ea-4005-8e3b-aaf61c2d7de3 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.621955 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.622623 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.622939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.623216 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.623943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.625690 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19c57b-b645-4171-83cf-663a3106d144 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.635410 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1367/2742] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:23.639369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.648958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ecb1a-27e0-4732-840c-ef5ac4332e75 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.654471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.655357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.655640 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.655917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] PATH_INFO: `/v3/projects/2a1eabaf3217476cb9ad5c6d8f1d9578/users/c739e7c1b1c74839b59318c29910d682/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.671565 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1eabaf3217476cb9ad5c6d8f1d9578, user_id=c739e7c1b1c74839b59318c29910d682, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.674501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.689082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1376/2743] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:23 2022] PUT /identity/v3/projects/2a1eabaf3217476cb9ad5c6d8f1d9578/users/c739e7c1b1c74839b59318c29910d682/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:23.699592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.699888 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.700177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.727356 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] MFA Rules not processed for user `c739e7c1b1c74839b59318c29910d682`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:23.729217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:23.796601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1368/2744] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:23.801348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.866364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b4f1-6fbd-4fc6-a028-8a0781cd589b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.871428 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.872087 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.872414 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.872697 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.873403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.875316 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.902334 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1377/2745] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:56:23.906715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:23.917436 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45c8c0-4a5a-46bc-9e94-341fe53ed82a None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:23.973830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:23.974502 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:23.974789 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:23.975068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:23.975764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:23.977747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:23.998790 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1369/2746] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:56:23 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:56:24.003216 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:24.013960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab3f23-1b53-4e8a-b7a8-90931142948a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:24.018583 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:24.019239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.019527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.019808 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.020573 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:24.022167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:24.033582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1378/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:24.037996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:24.048038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6819c5d-f259-42fb-997a-3e52e987a11c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:24.052959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:24.053850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.054141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.054424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] PATH_INFO: `/v3/projects/2b5e137e3bf245039d2256132dfb6352/users/a86c7fa10c974ad7911f7e1e267c8810/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.069503 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5e137e3bf245039d2256132dfb6352, user_id=a86c7fa10c974ad7911f7e1e267c8810, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:24.073556 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:24.089772 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1370/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:24 2022] PUT /identity/v3/projects/2b5e137e3bf245039d2256132dfb6352/users/a86c7fa10c974ad7911f7e1e267c8810/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:24.094103 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:24.105245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d470-8e8a-4ae1-81ac-8f19c1fcfff3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:24.164084 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:24.164779 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.165066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.165345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.166591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:24.168402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060a86-eb58-4e72-aefd-7340a27f67ef admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:24.178927 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1379/2749] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:56:24.185887 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:24.196207 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78bc-e38b-4211-b37e-356033c48eed admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:24.201234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:24.202121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.202408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.202689 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] PATH_INFO: `/v3/projects/2b5e137e3bf245039d2256132dfb6352/users/a86c7fa10c974ad7911f7e1e267c8810/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.204723 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5e137e3bf245039d2256132dfb6352, user_id=a86c7fa10c974ad7911f7e1e267c8810, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:24.207374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:24.218165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1371/2750] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:56:24 2022] PUT /identity/v3/projects/2b5e137e3bf245039d2256132dfb6352/users/a86c7fa10c974ad7911f7e1e267c8810/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:24.229317 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.229572 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.229849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.256668 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] MFA Rules not processed for user `a86c7fa10c974ad7911f7e1e267c8810`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:24.258196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:24.335618 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1380/2751] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:24.348259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:24.350005 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:24.410998 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a878f-2633-4314-ae91-f08e954d89e4 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:24.414662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:24.415311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:24.416788 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:24.417082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:24.475688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:24.477141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:24.486738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1372/2752] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:26.005488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:26.006986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:26.020609 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec905f-8fa3-448c-8710-122940b19830 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:26.026816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:26.027882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:26.028397 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:26.028907 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:26.086749 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:26.089002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:26.097960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1381/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:26.643744 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:26.652751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35990cc-2fa9-4ae1-a316-da4f61932580 service cinder] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:26.656391 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:26.657034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:26.657315 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:26.657592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:26.666855 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:26.668311 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0364904-58e3-4b3a-99c6-5ee85ac0174b service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:26.677968 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1373/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:30.519245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:30.584902 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f480ae-5316-462f-855e-0c62634f1edd service cinder] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:30.590487 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:30.591424 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:30.591746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:30.592062 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] PATH_INFO: `/v3/users/39a4810919ef4136a51b9aa43dcba509` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:30.593460 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a4810919ef4136a51b9aa43dcba509)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:30.595611 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:30.644986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a4810919ef4136a51b9aa43dcba509'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:30.656944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a4810919ef4136a51b9aa43dcba509'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:30.657660 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a4810919ef4136a51b9aa43dcba509'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:30.658262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a4810919ef4136a51b9aa43dcba509'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:30.664754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a4810919ef4136a51b9aa43dcba509'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:30.678546 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1382/2755] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:30 2022] DELETE /identity/v3/users/39a4810919ef4136a51b9aa43dcba509 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:30.683996 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:30.684719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:30.684719 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:30.702105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:30.703259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:30.761518 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1374/2756] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:56:30.771392 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:30.772820 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:30.829787 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc99c71-15f1-4251-bd43-d28ac1c98d3d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:30.833535 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:30.834208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:30.834492 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:30.834768 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:30.843759 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:30.845229 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:30.855045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1383/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:56:31.174187 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:31.177291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:31.196374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16968f-daf4-488a-bf03-557cd160b28b None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:31.207324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:31.209155 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:31.209520 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:31.209993 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] PATH_INFO: `/v3/projects/ad955de97b974289b5ce185e77108b63` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:31.213158 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad955de97b974289b5ce185e77108b63)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:31.216910 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:31.280323 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad955de97b974289b5ce185e77108b63', 'request_id': 'req-8852ec39-ed86-4ee2-ad77-93fa6506b479'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.287108 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad955de97b974289b5ce185e77108b63', 'request_id': 'req-8852ec39-ed86-4ee2-ad77-93fa6506b479'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.295490 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad955de97b974289b5ce185e77108b63', 'request_id': 'req-8852ec39-ed86-4ee2-ad77-93fa6506b479'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.310657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] The token cache is being invalidate because project ad955de97b974289b5ce185e77108b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:31.311172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.312399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.314229 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1375/2758] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:31 2022] DELETE /identity/v3/projects/ad955de97b974289b5ce185e77108b63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:31.318388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:31.328738 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d9e6b-73db-45e1-a859-609f003ab122 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:31.391537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:31.392570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:31.392956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:31.393402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] PATH_INFO: `/v3/users/c739e7c1b1c74839b59318c29910d682` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:31.394694 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c739e7c1b1c74839b59318c29910d682)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:31.396899 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:31.452426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c739e7c1b1c74839b59318c29910d682'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.464471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c739e7c1b1c74839b59318c29910d682'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.465109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c739e7c1b1c74839b59318c29910d682'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.465719 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c739e7c1b1c74839b59318c29910d682'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.472970 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c739e7c1b1c74839b59318c29910d682'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.486984 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1384/2759] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:31 2022] DELETE /identity/v3/users/c739e7c1b1c74839b59318c29910d682 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:31.764883 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:31.766498 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:31.784465 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852ec39-ed86-4ee2-ad77-93fa6506b479 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:31.848048 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:31.848931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:31.849213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:31.849513 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] PATH_INFO: `/v3/projects/2a1eabaf3217476cb9ad5c6d8f1d9578` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:31.850703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1eabaf3217476cb9ad5c6d8f1d9578)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:31.852738 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:31.902923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1eabaf3217476cb9ad5c6d8f1d9578', 'request_id': 'req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.909056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1eabaf3217476cb9ad5c6d8f1d9578', 'request_id': 'req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.917021 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1eabaf3217476cb9ad5c6d8f1d9578', 'request_id': 'req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.927459 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] The token cache is being invalidate because project 2a1eabaf3217476cb9ad5c6d8f1d9578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:31.927829 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.928563 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:31.930208 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1376/2760] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:31 2022] DELETE /identity/v3/projects/2a1eabaf3217476cb9ad5c6d8f1d9578 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:31.934212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:31.935707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:31.948425 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d0192-6f19-4968-85d8-b6a97179580f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:32.004130 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:32.005026 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:32.005303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:32.005577 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] PATH_INFO: `/v3/users/a86c7fa10c974ad7911f7e1e267c8810` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:32.006758 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86c7fa10c974ad7911f7e1e267c8810)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:32.008821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:32.054273 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86c7fa10c974ad7911f7e1e267c8810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.066133 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86c7fa10c974ad7911f7e1e267c8810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.066801 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86c7fa10c974ad7911f7e1e267c8810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.067402 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86c7fa10c974ad7911f7e1e267c8810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.074604 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-9567c5fd-dc7a-4706-8571-fce1ed248aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86c7fa10c974ad7911f7e1e267c8810'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.087305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1385/2761] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:56:31 2022] DELETE /identity/v3/users/a86c7fa10c974ad7911f7e1e267c8810 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:32.371969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:56:32.374213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:32.392023 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58091e5-dd76-4e2b-95cb-8dc1de7e6b2e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:56:32.456688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:56:32.457562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:32.457851 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:32.458132 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] PATH_INFO: `/v3/projects/2b5e137e3bf245039d2256132dfb6352` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:32.459387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5e137e3bf245039d2256132dfb6352)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:56:32.461322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:56:32.510602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5e137e3bf245039d2256132dfb6352', 'request_id': 'req-21040a78-df2c-4d4f-9556-26c8118c0d8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.517053 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5e137e3bf245039d2256132dfb6352', 'request_id': 'req-21040a78-df2c-4d4f-9556-26c8118c0d8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.527061 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5e137e3bf245039d2256132dfb6352', 'request_id': 'req-21040a78-df2c-4d4f-9556-26c8118c0d8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.539550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] The token cache is being invalidate because project 2b5e137e3bf245039d2256132dfb6352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:56:32.539880 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.541343 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-21040a78-df2c-4d4f-9556-26c8118c0d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:56:32.543009 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1377/2762] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:56:32 2022] DELETE /identity/v3/projects/2b5e137e3bf245039d2256132dfb6352 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:56:42.611664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c176f5-9b35-463b-a139-e57fee3a9e63 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:56:42.612231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c176f5-9b35-463b-a139-e57fee3a9e63 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:56:42.612231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c176f5-9b35-463b-a139-e57fee3a9e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:56:42.629888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-69c176f5-9b35-463b-a139-e57fee3a9e63 None None] MFA Rules not processed for user `69585611ca7547adb43378445b4f1521`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:56:42.631010 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-69c176f5-9b35-463b-a139-e57fee3a9e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:56:42.721265 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1386/2763] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:57:44.145639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:57:44.146193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:57:44.146193 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:57:44.165515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] MFA Rules not processed for user `69585611ca7547adb43378445b4f1521`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:57:44.166726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:57:44.173677 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1378/2764] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:57:53.977329 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:57:53.978170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:57:53.978335 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:57:53.999394 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] MFA Rules not processed for user `fe1f5f6882eb4a9aa869ad32fbdb0d92`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:57:54.000793 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:57:54.059372 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1387/2765] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:58:03.050929 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:03.052421 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:03.108248 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc9173-fa6c-4fe8-979f-3b55de73c2c6 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:03.112051 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:03.112808 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:03.113094 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:03.113370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:03.115172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:03.188316 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:03.189667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:03.200392 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1379/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:07.003155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:07.004716 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:07.019835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9320a9-3f6d-4c66-b07d-3e353ce93545 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:07.024105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:07.024804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:07.025091 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:07.025395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:07.027193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:07.042511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:07.043971 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:07.056286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1388/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:39.430610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:39.432892 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:39.451328 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e0d15-8cfb-4db2-973d-c795f1797eff service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:39.464291 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:39.465265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:39.465950 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:39.466433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:39.470919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:39.496614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:39.498404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:39.510574 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1380/2768] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:58:48.833956 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:48.835784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:48.912488 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f903f59-29b0-4217-9c08-80e04a2d3a6c service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:48.919262 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:48.920088 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:48.920415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:48.920698 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] PATH_INFO: `/v3/users/69585611ca7547adb43378445b4f1521` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:48.921914 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69585611ca7547adb43378445b4f1521)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:48.924377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:48.969345 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69585611ca7547adb43378445b4f1521'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:48.981231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69585611ca7547adb43378445b4f1521'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:48.981911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69585611ca7547adb43378445b4f1521'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:48.982531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69585611ca7547adb43378445b4f1521'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:48.990071 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-72afd16e-1a31-43c7-ba5c-579be0bab977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69585611ca7547adb43378445b4f1521'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.003785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1389/2769] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:48 2022] DELETE /identity/v3/users/69585611ca7547adb43378445b4f1521 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:49.177103 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.187639 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bb39e-f5cc-4a3f-bd8e-89ce037c2e3d service nova] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.247764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.248648 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.248932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.249203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] PATH_INFO: `/v3/projects/a46a3e1f43434294a8e3d1ef8c04061b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.250374 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46a3e1f43434294a8e3d1ef8c04061b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.252443 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.300747 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46a3e1f43434294a8e3d1ef8c04061b', 'request_id': 'req-6f973587-b1b0-42e4-b68b-51d111403bb4'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.306628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46a3e1f43434294a8e3d1ef8c04061b', 'request_id': 'req-6f973587-b1b0-42e4-b68b-51d111403bb4'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.313786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46a3e1f43434294a8e3d1ef8c04061b', 'request_id': 'req-6f973587-b1b0-42e4-b68b-51d111403bb4'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.329411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] The token cache is being invalidate because project a46a3e1f43434294a8e3d1ef8c04061b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:49.329811 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.330562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-6f973587-b1b0-42e4-b68b-51d111403bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:49.332091 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1381/2770] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:49 2022] DELETE /identity/v3/projects/a46a3e1f43434294a8e3d1ef8c04061b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:49.337232 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.337636 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.338044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.359194 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:49.360439 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:49.419761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1390/2771] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:58:49.428652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.428943 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.429225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.452224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:49.453514 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:49.462536 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1382/2772] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:49.466767 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.477114 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b19fc-39d4-491e-92ed-3638880432ad None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.481730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.482381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.482669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.482948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.483674 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:58:49.483980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.485643 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.496905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1391/2773] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:58:49.501365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.511938 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e98b99-15ea-4698-9d2c-6d588aec3ee6 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.516605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.518397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.518688 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.518969 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.519673 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.521606 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.547235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1383/2774] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:49 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:58:49.551751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.561511 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eead3-fb69-4501-99ce-ff3a9e2365bf admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.623486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.624074 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.624391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.624673 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.625369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.628476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.651782 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1392/2775] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:49 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:58:49.653656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.664703 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5218818-3df3-4744-b3f9-9a0cf61836af admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.669296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.669978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.670259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.670533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.671277 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.672902 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.683367 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1384/2776] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:49.687476 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.697363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003c30a-77d3-4f1f-bf25-5107de76da7f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.701980 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.702729 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.702922 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.703221 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.703931 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.706245 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e614177-91b7-4ebc-aaa7-d3e7ada21c64 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.716158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1393/2777] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:49.721127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.731019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97eefb-9162-4419-bae1-d3cc1a11fb83 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.735768 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.736675 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.736956 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.737231 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] PATH_INFO: `/v3/projects/769fd5ac992a47e0afd3996ef9786b70/users/1ea0e2983fca43819e432a19e6ea2b11/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.751441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=769fd5ac992a47e0afd3996ef9786b70, user_id=1ea0e2983fca43819e432a19e6ea2b11, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.754110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.766730 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1385/2778] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:49 2022] PUT /identity/v3/projects/769fd5ac992a47e0afd3996ef9786b70/users/1ea0e2983fca43819e432a19e6ea2b11/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:58:49.777250 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.777548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.777855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.805359 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] MFA Rules not processed for user `1ea0e2983fca43819e432a19e6ea2b11`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:49.806561 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:49.871543 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1394/2779] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:49.883139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:49.884760 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:49.956222 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7cbd5f-546d-4bfa-8df5-1ee29886c7cf admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:49.961733 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:49.962368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:49.962654 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:49.962931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:49.970964 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:49.972559 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5aa90-44e5-4b6c-a05f-c639d5ddf0f8 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:49.981145 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1386/2780] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:52.640680 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:52.713445 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46941e24-0da5-4a91-a5c8-8f6b6cff811c None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:52.717857 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:52.718741 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:52.719016 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:52.719286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] PATH_INFO: `/v3/users/1ea0e2983fca43819e432a19e6ea2b11` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:52.721560 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea0e2983fca43819e432a19e6ea2b11)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:52.723461 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:52.769343 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea0e2983fca43819e432a19e6ea2b11'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:52.780707 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea0e2983fca43819e432a19e6ea2b11'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:52.781375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea0e2983fca43819e432a19e6ea2b11'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:52.781986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea0e2983fca43819e432a19e6ea2b11'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:52.789069 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea0e2983fca43819e432a19e6ea2b11'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:52.802040 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1395/2781] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:52 2022] DELETE /identity/v3/users/1ea0e2983fca43819e432a19e6ea2b11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:52.806650 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:52.807133 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:52.807253 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:52.824263 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:52.825485 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:52.884481 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1387/2782] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:52.895299 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:52.896751 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:52.952156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7e0e5-1f95-4267-b0f1-a33a6e74e37d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:52.956895 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:52.957539 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:52.957821 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:52.958096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:52.966955 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:52.968410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d1de9-af4a-4b5b-9ef2-84a8a00fa1f3 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:52.982851 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1396/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:53.257172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.258715 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:53.270408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85a84-ec5d-4abd-8f6c-caad91b37999 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.275068 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.275926 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.276210 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.276534 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] PATH_INFO: `/v3/projects/769fd5ac992a47e0afd3996ef9786b70` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.277847 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769fd5ac992a47e0afd3996ef9786b70)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.279931 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.332814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769fd5ac992a47e0afd3996ef9786b70', 'request_id': 'req-c34ef080-3a6a-4b16-bf4d-d495007a3f86'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:53.338799 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769fd5ac992a47e0afd3996ef9786b70', 'request_id': 'req-c34ef080-3a6a-4b16-bf4d-d495007a3f86'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:53.346455 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769fd5ac992a47e0afd3996ef9786b70', 'request_id': 'req-c34ef080-3a6a-4b16-bf4d-d495007a3f86'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:53.356528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] The token cache is being invalidate because project 769fd5ac992a47e0afd3996ef9786b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:53.356815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:53.357441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c34ef080-3a6a-4b16-bf4d-d495007a3f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:53.359017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1388/2784] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:53 2022] DELETE /identity/v3/projects/769fd5ac992a47e0afd3996ef9786b70 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:53.364722 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.365015 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.365297 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.383523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:53.384750 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:53.444001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1397/2785] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:53.452895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.453182 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.453486 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.472783 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:53.474001 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:53.482015 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1389/2786] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:53.487349 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.497143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68229c-60e9-4e0e-8e73-dcd4607d3991 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.502377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.503031 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.503307 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.503629 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.504348 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:58:53.504655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.506246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.519472 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1398/2787] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:58:53.523900 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.542780 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad7d3f-31c5-4fd7-bedf-0a0ac76153bf None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.547572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.548235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.549152 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.549432 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.550139 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.552383 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.580381 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1390/2788] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/projects => generated 403 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:53.586641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.597276 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb324fb8-9fa8-4eac-9bfc-b06f5cd1f615 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.654105 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.654858 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.655143 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.655421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.656192 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.659268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.680201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1399/2789] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:53.684726 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.696206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28c040-a2a4-4cf6-9c81-ea09ed1ff539 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.700881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.701543 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.701831 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.702110 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.702932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.705417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.716657 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1391/2790] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:53.721517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.731473 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda42d-bbe9-4980-8930-c21b4be70fff admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.736926 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.737761 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.738045 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.738319 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.739047 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.740687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8176c-2624-493d-8dc6-4ac795241f0c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.750732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1400/2791] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:53.755225 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.765482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af378744-393f-4df5-ba72-a9106bbfdc00 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.770217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.771095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.771384 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.771664 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] PATH_INFO: `/v3/projects/617dfc5303a3485cb75783b38c8ae62f/users/01bcdc001116423f8be551b20321e6dd/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.786604 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=617dfc5303a3485cb75783b38c8ae62f, user_id=01bcdc001116423f8be551b20321e6dd, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.789309 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:53.802796 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1392/2792] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:53 2022] PUT /identity/v3/projects/617dfc5303a3485cb75783b38c8ae62f/users/01bcdc001116423f8be551b20321e6dd/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:58:53.812958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.813249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.813525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.839671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] MFA Rules not processed for user `01bcdc001116423f8be551b20321e6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:53.840829 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:53.906580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1401/2793] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:53.911951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:53.977234 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf2c49-1ac7-4175-9657-816f820c9b67 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:53.981939 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:53.982594 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:53.982877 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:53.983153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:53.983852 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:53.985775 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.012099 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1393/2794] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:53 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:54.016305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.027266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8aef2-3d18-424e-b802-7d4ec8966aa3 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.082986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.083657 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.083941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.084214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.084934 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.086867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.109930 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1402/2795] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:54 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:54.114223 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.124608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfcb51e-be9b-43d8-bc3b-f539cdf37181 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.129357 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.130019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.130306 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.130588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.131317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.133019 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.144516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1394/2796] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:54.149286 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.162632 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef1c9-b865-4c12-99e9-46e3df7a0f78 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.168706 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.169892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.170347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.170795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] PATH_INFO: `/v3/projects/f5991a9f62d84beaabbed45f3241deec/users/4a73f7c6aa1c44a89cbe6a49e7b9d050/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.188654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5991a9f62d84beaabbed45f3241deec, user_id=4a73f7c6aa1c44a89cbe6a49e7b9d050, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.192096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.208952 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1403/2797] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:54 2022] PUT /identity/v3/projects/f5991a9f62d84beaabbed45f3241deec/users/4a73f7c6aa1c44a89cbe6a49e7b9d050/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:54.212975 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.223482 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df9d5-46fe-46b1-a76e-f1382cb10cb5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.279845 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.280541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.280828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.281104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.281832 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.284012 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323b738-6015-4ce8-a615-95b74d6d26b5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.293909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1395/2798] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:54.298126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.318129 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa245c0-d00c-482f-b395-ef35f77a6d1a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.323687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.324626 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.324912 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.325193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] PATH_INFO: `/v3/projects/f5991a9f62d84beaabbed45f3241deec/users/4a73f7c6aa1c44a89cbe6a49e7b9d050/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.327210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5991a9f62d84beaabbed45f3241deec, user_id=4a73f7c6aa1c44a89cbe6a49e7b9d050, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.335595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.347085 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1404/2799] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:54 2022] PUT /identity/v3/projects/f5991a9f62d84beaabbed45f3241deec/users/4a73f7c6aa1c44a89cbe6a49e7b9d050/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:54.357572 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.357863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.358143 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.385424 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] MFA Rules not processed for user `4a73f7c6aa1c44a89cbe6a49e7b9d050`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:54.386541 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:54.457027 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1396/2800] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:54.467789 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.469649 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:54.528094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa7b73-2440-44e8-a6ac-3d1de548991d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.531805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.532489 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.533395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.534593 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.543939 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.545422 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe95f8-5e49-4641-be75-2117fa2c553b service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.556977 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1405/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:54.695262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.762893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f9157-39c1-441d-a87c-8024eb693e73 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:54.767903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:54.768871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.769154 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.769426 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] PATH_INFO: `/v3/users/01bcdc001116423f8be551b20321e6dd` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.770640 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bcdc001116423f8be551b20321e6dd)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:54.772609 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:54.817828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bcdc001116423f8be551b20321e6dd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:54.829120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bcdc001116423f8be551b20321e6dd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:54.830380 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bcdc001116423f8be551b20321e6dd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:54.831112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bcdc001116423f8be551b20321e6dd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:54.837903 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bcdc001116423f8be551b20321e6dd'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:54.850708 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1397/2802] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:54 2022] DELETE /identity/v3/users/01bcdc001116423f8be551b20321e6dd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:54.855305 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:54.855775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:54.855872 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:54.873556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:54.874780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:54.937641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1406/2803] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:54.948529 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:54.949958 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:55.007973 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2a3-084a-4655-bf6d-01d3e19634a2 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:55.011612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:55.012258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:55.012578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:55.012860 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:55.022652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:55.024090 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:55.033659 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1398/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:55.301178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:55.302617 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:55.315710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b97c3-cc2b-40f9-b802-c059b1d1f228 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:55.320683 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:55.322150 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:55.322443 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:55.322921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] PATH_INFO: `/v3/projects/617dfc5303a3485cb75783b38c8ae62f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:55.324158 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=617dfc5303a3485cb75783b38c8ae62f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:55.326128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:55.372101 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '617dfc5303a3485cb75783b38c8ae62f', 'request_id': 'req-5017994b-3597-44f2-9e87-0357bdbc8f89'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.378944 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '617dfc5303a3485cb75783b38c8ae62f', 'request_id': 'req-5017994b-3597-44f2-9e87-0357bdbc8f89'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.393417 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '617dfc5303a3485cb75783b38c8ae62f', 'request_id': 'req-5017994b-3597-44f2-9e87-0357bdbc8f89'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.403201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] The token cache is being invalidate because project 617dfc5303a3485cb75783b38c8ae62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:55.403486 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.404102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.405664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1407/2805] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:55 2022] DELETE /identity/v3/projects/617dfc5303a3485cb75783b38c8ae62f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:55.409871 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:55.419588 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca2d44-8bb9-4892-9946-0a7e60c20b21 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:55.473769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:55.474553 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:55.474839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:55.475115 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] PATH_INFO: `/v3/users/4a73f7c6aa1c44a89cbe6a49e7b9d050` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:55.476295 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a73f7c6aa1c44a89cbe6a49e7b9d050)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:55.478220 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:55.522658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a73f7c6aa1c44a89cbe6a49e7b9d050'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.533980 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a73f7c6aa1c44a89cbe6a49e7b9d050'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.534842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a73f7c6aa1c44a89cbe6a49e7b9d050'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.535479 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a73f7c6aa1c44a89cbe6a49e7b9d050'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.542352 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-2f36625d-22d4-467c-a77c-ed1b2cfb7da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a73f7c6aa1c44a89cbe6a49e7b9d050'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.554857 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1399/2806] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:55 2022] DELETE /identity/v3/users/4a73f7c6aa1c44a89cbe6a49e7b9d050 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:55.853173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:55.854665 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:55.868303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017994b-3597-44f2-9e87-0357bdbc8f89 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:55.930805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:55.931664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:55.931950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:55.932226 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] PATH_INFO: `/v3/projects/f5991a9f62d84beaabbed45f3241deec` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:55.933451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5991a9f62d84beaabbed45f3241deec)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:55.935367 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:55.981873 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5991a9f62d84beaabbed45f3241deec', 'request_id': 'req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:55.993138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5991a9f62d84beaabbed45f3241deec', 'request_id': 'req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:56.000946 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5991a9f62d84beaabbed45f3241deec', 'request_id': 'req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:56.016132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] The token cache is being invalidate because project f5991a9f62d84beaabbed45f3241deec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:56.016375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:56.017078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b1f3951f-8556-4301-b6fc-dbd431bc2a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:56.018627 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1408/2807] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:55 2022] DELETE /identity/v3/projects/f5991a9f62d84beaabbed45f3241deec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:56.023656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.024135 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.024247 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.042587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:56.043826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:56.112365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1400/2808] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:56.121440 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.121728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.122006 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.140001 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:56.141237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:56.149812 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1409/2809] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:56.154314 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.164592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350557e-b637-4e85-888b-72c03b0f3586 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.169206 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.169854 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.170138 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.170416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.171137 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:58:56.171446 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.173080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.185093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1401/2810] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:58:56.189772 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.198856 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904bf56-ec93-45b3-9015-60c1eb34fb60 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.203423 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.204066 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.204403 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.205352 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.205903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.207791 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.237866 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1410/2811] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:56.239000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.248844 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252071-bcf7-493a-ae67-aefc14442bce admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.304073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.304679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.304966 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.305246 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.305951 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.307859 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.328565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1402/2812] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 16:58:56.333950 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.344378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2490ff-926d-4da0-9c71-810178ece81f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.349576 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.350233 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.350519 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.350795 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.351525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.353408 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.363735 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1411/2813] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:56.367769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.377691 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725142f1-84a8-4721-9262-e74d3588b5eb admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.382355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.383011 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.383296 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.383571 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.384351 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.385945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bdf5d-0b87-4483-9b6f-fece88000dc6 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.396453 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1403/2814] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:56.400518 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.411078 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a04b-56df-4c20-b807-31d1a1e5391a admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.415686 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.416591 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.416877 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.417157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] PATH_INFO: `/v3/projects/796eae39e59b4c458da2a7ae81aed20d/users/3dcdc25521c642908b77dd8e4abb4ced/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.436032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=796eae39e59b4c458da2a7ae81aed20d, user_id=3dcdc25521c642908b77dd8e4abb4ced, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.438809 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.453057 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1412/2815] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:56 2022] PUT /identity/v3/projects/796eae39e59b4c458da2a7ae81aed20d/users/3dcdc25521c642908b77dd8e4abb4ced/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:56.464177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.464493 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.464773 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.491782 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] MFA Rules not processed for user `3dcdc25521c642908b77dd8e4abb4ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:56.493105 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:56.557778 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1404/2816] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:56.562132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.623147 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed575320-ca36-4d1f-baba-7c57c4c68b8d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.628198 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.628911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.629196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.629474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.630182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.632090 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.661721 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1413/2817] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:56.665169 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.676776 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d0141-54bf-4560-87d6-cde0fda01c19 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.736750 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.737652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.737977 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.738304 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.739058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.741172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.761441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1405/2818] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:56.765381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.776230 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b1ea-ae9e-4f22-841b-d24e5671907f admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.780997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.781655 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.781941 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.782218 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.784176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.785833 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.796545 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1414/2819] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:56.801935 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.811876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bd297-a94e-456f-8d65-400ccaf7ced2 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.817240 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.818119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.818401 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.818678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] PATH_INFO: `/v3/projects/b4be18361a6c464dade41e28c0778cd0/users/7e1f523d58684c2498ec8ace9907c371/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.834197 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4be18361a6c464dade41e28c0778cd0, user_id=7e1f523d58684c2498ec8ace9907c371, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.836919 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.850120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1406/2820] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:56 2022] PUT /identity/v3/projects/b4be18361a6c464dade41e28c0778cd0/users/7e1f523d58684c2498ec8ace9907c371/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:58:56.854210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.864306 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538801b2-708e-4768-8b89-cc671ed84523 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.919733 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.920468 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.920725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.921000 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.921747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.924032 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87213-825f-4027-9d73-9d8dfd2d5c33 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.935566 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1415/2821] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:56.941440 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:56.953815 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07f5f5-b5ee-48e5-bb3e-be9ab4c40bfb admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:56.960317 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:56.961342 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.961711 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.962056 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] PATH_INFO: `/v3/projects/b4be18361a6c464dade41e28c0778cd0/users/7e1f523d58684c2498ec8ace9907c371/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:56.964302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4be18361a6c464dade41e28c0778cd0, user_id=7e1f523d58684c2498ec8ace9907c371, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:56.967141 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:56.979535 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1407/2822] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:56 2022] PUT /identity/v3/projects/b4be18361a6c464dade41e28c0778cd0/users/7e1f523d58684c2498ec8ace9907c371/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:56.992823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:56.993291 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:56.993671 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:57.025704 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] MFA Rules not processed for user `7e1f523d58684c2498ec8ace9907c371`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:57.026965 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:57.108608 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1416/2823] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:56 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:57.120630 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:57.122318 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:57.186568 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a190ae6-f908-44d1-a852-8762d3088a07 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:57.190824 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:57.191551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:57.191836 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:57.192113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:57.201621 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:57.203069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c2dca-ecc6-48aa-97c9-874393b7bc6a service cinder] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:57.216457 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1408/2824] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:57.638012 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:57.700183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaec9d3-1245-4936-8774-5fcfd00052f9 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:57.706157 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:57.707035 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:57.707326 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:57.707596 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] PATH_INFO: `/v3/users/3dcdc25521c642908b77dd8e4abb4ced` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:57.708849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcdc25521c642908b77dd8e4abb4ced)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:57.710790 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:57.760189 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcdc25521c642908b77dd8e4abb4ced'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:57.772708 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcdc25521c642908b77dd8e4abb4ced'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:57.773467 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcdc25521c642908b77dd8e4abb4ced'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:57.774109 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcdc25521c642908b77dd8e4abb4ced'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:57.780982 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcdc25521c642908b77dd8e4abb4ced'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:57.794664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1417/2825] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:57 2022] DELETE /identity/v3/users/3dcdc25521c642908b77dd8e4abb4ced => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 16:58:57.799686 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:57.800032 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:57.800451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:57.818492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:57.819781 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:57.890031 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1409/2826] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:57.900690 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:57.902096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:57.969093 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec9539-3b9b-465a-8feb-76523706499c admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:57.974464 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:57.975127 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:57.975411 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:57.975689 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:57.985246 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:57.986711 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:57.996880 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1418/2827] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:58:58.270419 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:58.271901 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:58.284010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d9125-576a-4523-9414-7d893a603b62 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:58.288656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:58.289516 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:58.289839 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:58.290071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] PATH_INFO: `/v3/projects/796eae39e59b4c458da2a7ae81aed20d` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:58.291286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=796eae39e59b4c458da2a7ae81aed20d)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:58.293265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:58.341987 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796eae39e59b4c458da2a7ae81aed20d', 'request_id': 'req-dce4e71a-0e24-4dff-be10-283873891f8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.349071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796eae39e59b4c458da2a7ae81aed20d', 'request_id': 'req-dce4e71a-0e24-4dff-be10-283873891f8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.356840 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796eae39e59b4c458da2a7ae81aed20d', 'request_id': 'req-dce4e71a-0e24-4dff-be10-283873891f8d'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.368062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] The token cache is being invalidate because project 796eae39e59b4c458da2a7ae81aed20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:58.368387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.369037 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.370585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1410/2828] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:58 2022] DELETE /identity/v3/projects/796eae39e59b4c458da2a7ae81aed20d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:58.374710 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:58.385644 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1890c3f-ac96-4685-8dd7-fd0aa51b77bc service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:58.457156 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:58.458115 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:58.458523 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:58.459011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] PATH_INFO: `/v3/users/7e1f523d58684c2498ec8ace9907c371` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:58.461287 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f523d58684c2498ec8ace9907c371)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:58.463434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:58.510126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f523d58684c2498ec8ace9907c371'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.521432 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f523d58684c2498ec8ace9907c371'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.522126 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f523d58684c2498ec8ace9907c371'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.522754 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f523d58684c2498ec8ace9907c371'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.529451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-8c033604-a0ac-4dfb-9b2a-6e6b104501d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f523d58684c2498ec8ace9907c371'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.544295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1419/2829] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:58:58 2022] DELETE /identity/v3/users/7e1f523d58684c2498ec8ace9907c371 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:58.835442 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:58.837120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:58.852332 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4e71a-0e24-4dff-be10-283873891f8d admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:58.909004 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:58.909908 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:58.910198 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:58.910562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] PATH_INFO: `/v3/projects/b4be18361a6c464dade41e28c0778cd0` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:58.911742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4be18361a6c464dade41e28c0778cd0)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:58.913755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:58.961179 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4be18361a6c464dade41e28c0778cd0', 'request_id': 'req-df40228d-4e83-4681-875e-34906980dff8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.967219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4be18361a6c464dade41e28c0778cd0', 'request_id': 'req-df40228d-4e83-4681-875e-34906980dff8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.975117 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4be18361a6c464dade41e28c0778cd0', 'request_id': 'req-df40228d-4e83-4681-875e-34906980dff8'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.986667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] The token cache is being invalidate because project b4be18361a6c464dade41e28c0778cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:58:58.987059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.987767 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-df40228d-4e83-4681-875e-34906980dff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:58:58.989629 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1411/2830] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:58:58 2022] DELETE /identity/v3/projects/b4be18361a6c464dade41e28c0778cd0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:58.994556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:58.995080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:58.995182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.013028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:59.014272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:59.078183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1420/2831] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:59.086109 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.086402 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.086687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.106687 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:59.107906 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:59.120528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1412/2832] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:59.125363 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.143531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839c50-fd5b-4131-a155-0382edd42424 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.148322 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.148994 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.149272 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.149549 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.150284 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:58:59.150588 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.152213 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.166728 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1421/2833] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:58:59.173441 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.185062 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0cadb8-b8ec-4e25-978c-7b4eb73d057e None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.190371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.191034 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.191322 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.191602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.192325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.194245 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.221389 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1413/2834] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:59.227104 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.237224 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c8e3-104f-4a08-b88f-bba2c45bc6d5 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.292555 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.293228 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.293510 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.293785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.294491 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.296416 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.315908 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1422/2835] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:59.320069 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.330769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d038926-363b-46f7-8a17-007f34fc239c admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.335386 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.336054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.336375 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.336658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.337379 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.338978 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.350153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1414/2836] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:59.354204 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.364212 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3feff8-b09a-45d0-9ca5-8d692a9717c4 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.369002 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.369687 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.369969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.370243 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.370961 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.372585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b28cbe-43a7-42b4-85cf-5fcde063c841 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.382610 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1423/2837] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:59.386863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.397325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67483a1-6c31-44a0-8542-65ed400b34b4 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.401959 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.402834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] REQUEST_METHOD: `PUT` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.403121 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.403399 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] PATH_INFO: `/v3/projects/4413c9bf0b4f4485a438fec7225fd910/users/cef88b7187754a1f8b08585e030f16ad/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.419448 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4413c9bf0b4f4485a438fec7225fd910, user_id=cef88b7187754a1f8b08585e030f16ad, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.422214 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.436915 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1415/2838] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:59 2022] PUT /identity/v3/projects/4413c9bf0b4f4485a438fec7225fd910/users/cef88b7187754a1f8b08585e030f16ad/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:59.450201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.450201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.450201 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.479544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] MFA Rules not processed for user `cef88b7187754a1f8b08585e030f16ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:58:59.480732 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:58:59.551714 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1424/2839] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:58:59.558030 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.630528 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd1974-634a-4bff-a2f2-24e176f04092 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.635602 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.636302 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.636587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.636869 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.637599 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.639506 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.666372 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1416/2840] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:59.670447 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.681300 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de6227-ece4-496b-ab68-00c98e716387 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.740161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.741269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.741753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.742222 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.743550 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.747199 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.773624 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1425/2841] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:58:59 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:58:59.778826 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.789601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ff4e-6cce-422b-abc0-c2209deea5fa admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.794321 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.794989 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.795270 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.795545 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.796299 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.797893 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.810071 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1417/2842] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:59.815173 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.825290 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed228-34c3-4fb0-b65d-a7810846c6a0 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.830653 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.831537 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.831839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.832111 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] PATH_INFO: `/v3/projects/0a0f94ed5f75470fbc33d41f637acde9/users/3c432599043840fe9bad99d5106477c7/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.850207 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f94ed5f75470fbc33d41f637acde9, user_id=3c432599043840fe9bad99d5106477c7, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.855448 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.869538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1426/2843] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:59 2022] PUT /identity/v3/projects/0a0f94ed5f75470fbc33d41f637acde9/users/3c432599043840fe9bad99d5106477c7/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:58:59.873501 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.884942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f0b69-49aa-4592-b4c0-7a776ba51188 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.942876 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.943550 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.943834 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.944112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.944942 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.946576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ff8db-320b-4e46-a26e-12875cb01b63 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.956923 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1418/2844] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:58:59.961882 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:58:59.972410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb33a-16d0-4e65-a7d6-b3ac071908d3 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:58:59.977176 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:58:59.978072 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:58:59.978356 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:58:59.978641 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] PATH_INFO: `/v3/projects/0a0f94ed5f75470fbc33d41f637acde9/users/3c432599043840fe9bad99d5106477c7/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:58:59.980715 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f94ed5f75470fbc33d41f637acde9, user_id=3c432599043840fe9bad99d5106477c7, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:58:59.983380 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:58:59.994918 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1427/2845] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:58:59 2022] PUT /identity/v3/projects/0a0f94ed5f75470fbc33d41f637acde9/users/3c432599043840fe9bad99d5106477c7/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:00.006828 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:00.007119 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:00.007400 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:00.034439 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] MFA Rules not processed for user `3c432599043840fe9bad99d5106477c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:00.035658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:00.104868 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1419/2846] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:00.116517 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:00.118429 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:00.183945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaecfed-b9e9-42cc-bab7-035116484591 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:00.187601 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df7219cea0ae464e8df960dd38906b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:00.188239 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:00.188585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:00.188885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:00.198769 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:00.200208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b62e0e-d5c9-451e-900f-7484226fa81c service cinder] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:00.210063 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1428/2847] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:01.570397 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:01.639407 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd6871-3d7b-40c8-ae82-0d6685e5c257 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:01.645042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:01.645917 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:01.646199 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:01.646475 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] PATH_INFO: `/v3/users/cef88b7187754a1f8b08585e030f16ad` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:01.648052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef88b7187754a1f8b08585e030f16ad)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:01.650494 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:01.703476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef88b7187754a1f8b08585e030f16ad'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:01.719038 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef88b7187754a1f8b08585e030f16ad'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:01.719787 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef88b7187754a1f8b08585e030f16ad'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:01.720484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef88b7187754a1f8b08585e030f16ad'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:01.728427 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef88b7187754a1f8b08585e030f16ad'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:01.747129 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1420/2848] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:59:01 2022] DELETE /identity/v3/users/cef88b7187754a1f8b08585e030f16ad => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:01.752419 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:01.753094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:01.753094 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:01.771038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:01.772155 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:01.842823 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1429/2849] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:01.854610 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:01.856067 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:01.912136 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42840cb-e2c6-4f1f-94cf-ae1a81e3b908 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:01.915728 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:01.916406 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:01.916697 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:01.916971 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:01.927601 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:01.929080 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:01.938786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1421/2850] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:02.205616 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:02.207138 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:02.220892 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805a9f-c647-4c4a-a43b-6c7149e41ab6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:02.225678 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:02.227178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:02.227474 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:02.227954 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] PATH_INFO: `/v3/projects/4413c9bf0b4f4485a438fec7225fd910` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:02.229434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4413c9bf0b4f4485a438fec7225fd910)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:02.231785 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:02.277582 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4413c9bf0b4f4485a438fec7225fd910', 'request_id': 'req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.284531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4413c9bf0b4f4485a438fec7225fd910', 'request_id': 'req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.292210 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4413c9bf0b4f4485a438fec7225fd910', 'request_id': 'req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.302676 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] The token cache is being invalidate because project 4413c9bf0b4f4485a438fec7225fd910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:59:02.302960 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.303580 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.305152 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1430/2851] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:59:02 2022] DELETE /identity/v3/projects/4413c9bf0b4f4485a438fec7225fd910 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:02.309144 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:02.318505 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dd612-8991-4ee4-9ae6-9660579df9fc service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:02.379008 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:02.379881 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:02.380166 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:02.380474 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] PATH_INFO: `/v3/users/3c432599043840fe9bad99d5106477c7` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:02.381662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c432599043840fe9bad99d5106477c7)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:02.383577 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:02.431188 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c432599043840fe9bad99d5106477c7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.442264 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c432599043840fe9bad99d5106477c7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.442940 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c432599043840fe9bad99d5106477c7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.443533 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c432599043840fe9bad99d5106477c7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.450578 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0600934-8a3f-4fa1-8001-a902a7d9b920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c432599043840fe9bad99d5106477c7'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.463371 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1422/2852] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 16:59:02 2022] DELETE /identity/v3/users/3c432599043840fe9bad99d5106477c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:02.758849 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:02.760347 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:02.774292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e724-e23d-4734-8062-20a4ac2ec2e7 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:02.834496 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:02.835381 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:02.835669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:02.835948 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] PATH_INFO: `/v3/projects/0a0f94ed5f75470fbc33d41f637acde9` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:02.837234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f94ed5f75470fbc33d41f637acde9)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:02.839211 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:02.889038 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f94ed5f75470fbc33d41f637acde9', 'request_id': 'req-b5812b88-f89d-409a-b5d9-f27226af9c65'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.896044 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f94ed5f75470fbc33d41f637acde9', 'request_id': 'req-b5812b88-f89d-409a-b5d9-f27226af9c65'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.905295 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f94ed5f75470fbc33d41f637acde9', 'request_id': 'req-b5812b88-f89d-409a-b5d9-f27226af9c65'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.916634 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] The token cache is being invalidate because project 0a0f94ed5f75470fbc33d41f637acde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 16:59:02.916921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.917585 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-b5812b88-f89d-409a-b5d9-f27226af9c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 16:59:02.919167 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1431/2853] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 16:59:02 2022] DELETE /identity/v3/projects/0a0f94ed5f75470fbc33d41f637acde9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:02.924593 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:02.925082 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:02.925203 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:02.943174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:02.944417 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:03.004127 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1423/2854] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 16:59:03.012183 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.012502 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.012781 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.031391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:03.032744 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:03.040784 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1432/2855] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:03.045120 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.055863 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4672f20-b410-4dfc-b311-80a071099166 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.060769 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.061468 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.061774 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.062052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] PATH_INFO: `/v3/domains` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.062784 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 16:59:03.063095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.065904 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.077909 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1424/2856] 10.222.0.48 () {58 vars in 1152 bytes} [Tue May 10 16:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 16:59:03.082855 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.092161 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9592c-b215-424b-9499-1557c9c0fe1f None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.098377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.099039 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.099341 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.100514 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.101219 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.103165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.132070 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1433/2857] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:59:03 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:59:03.136258 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.146658 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534caef-4183-465a-8202-a4c06241cf5e admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.209070 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.209800 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.210093 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.210377 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] PATH_INFO: `/v3/users` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.211063 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.217190 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.240605 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1425/2858] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:59:03 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:59:03.245252 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.256869 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e2555-a811-43e5-a6fd-dac70d9857cb admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.261451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.262098 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.262377 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.262669 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] PATH_INFO: `/v3/roles` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.263357 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.265080 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.275214 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1434/2859] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:59:03.279211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.290286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9265c2-7ae1-4709-a549-af125e4f6ecf admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.294947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.295608 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.295895 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.296174 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.296932 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.299104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb1b66-80d5-4750-b913-8bd237796e21 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.310219 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1426/2860] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:59:03.314520 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.324008 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c9162-9506-44c6-818f-beb51754685b admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.328804 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.329762 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.330292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.330292 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] PATH_INFO: `/v3/projects/4ca9807e934c4826bb948e391d7a315a/users/5fafb32dcef84cc7be2399905c2611c1/roles/752329c75e7648f4a9c9d02695370fab` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.344915 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca9807e934c4826bb948e391d7a315a, user_id=5fafb32dcef84cc7be2399905c2611c1, role_id=752329c75e7648f4a9c9d02695370fab)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.348747 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.362458 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1435/2861] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:59:03 2022] PUT /identity/v3/projects/4ca9807e934c4826bb948e391d7a315a/users/5fafb32dcef84cc7be2399905c2611c1/roles/752329c75e7648f4a9c9d02695370fab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:03.367515 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.367846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.368165 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.385320 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] MFA Rules not processed for user `2e2d8842c7d74786b278cdcd7a3dd77d`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:03.386652 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:03.454420 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1427/2862] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:03.464997 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:03.466739 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:03.521178 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844e4ae-d198-4c51-886a-dd091aed9632 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:03.524863 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:03.525501 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:03.525816 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:03.526095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:03.535942 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:03.537430 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65209a47-e602-4c4b-a16c-fc9903a0f422 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:03.546886 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1436/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:04.600387 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:04.610403 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a03ec4-5a70-46a6-b448-a1a6807d9932 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:04.615355 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:04.616212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:04.616531 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:04.616809 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:04.618751 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:04.633492 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:04.634957 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:04.645307 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1428/2864] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:07.716391 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:07.716936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:07.716936 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:07.746415 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] MFA Rules not processed for user `5fafb32dcef84cc7be2399905c2611c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:07.747635 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:07.815470 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1437/2865] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:07.819088 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:07.832557 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eef6d9-a9b4-4534-9582-0708dce46b33 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:07.837324 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:07.838085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:07.838449 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:07.838736 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:07.839684 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:07.841722 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:07.873290 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1429/2866] 10.222.0.48 () {60 vars in 1152 bytes} [Tue May 10 16:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:59:07.874656 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:07.886903 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a77dc-03d2-4d41-af3d-eb384e82d48a None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:07.952827 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:07.954375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:07.954375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:07.954375 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] PATH_INFO: `/v3/users` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:07.955806 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:07.958193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:07.978338 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1438/2867] 10.222.0.48 () {60 vars in 1143 bytes} [Tue May 10 16:59:07 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 16:59:07.982433 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:07.993244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a8159-da8a-4d4e-8e5c-d2bef3c93f88 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:07.998085 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:07.998758 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:07.999044 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:07.999319 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:08.000054 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:08.002243 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:08.014395 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1430/2868] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:59:08.019433 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:08.029570 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b372a-09b5-4fea-9090-4db3344d361d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:08.034522 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:08.035418 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:08.035700 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:08.035976 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] PATH_INFO: `/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c/users/edeb113df9cd4e99925082eb2f48d85b/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:08.051542 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b091aef6284737ae21ebdeb3cd0f0c, user_id=edeb113df9cd4e99925082eb2f48d85b, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:08.054389 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:08.070933 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1439/2869] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:59:08 2022] PUT /identity/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c/users/edeb113df9cd4e99925082eb2f48d85b/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:08.075181 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:08.086598 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6acfb6-0d34-44a7-ab16-ef958fef3477 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:08.164865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:08.165678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:08.165972 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:08.166262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:08.167153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:08.169055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df70b1-fae4-4e21-bbea-dcc893475ae2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:08.182671 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1431/2870] 10.222.0.48 () {58 vars in 1121 bytes} [Tue May 10 16:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 16:59:08.194917 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:08.205469 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df87ae7-9cf0-40ed-8a15-2066578832ca admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:08.211803 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:08.212556 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] REQUEST_METHOD: `PUT` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:08.212664 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:08.212864 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] PATH_INFO: `/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c/users/edeb113df9cd4e99925082eb2f48d85b/roles/1b495dbb303447258ed6e7db6e67280f` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:08.214919 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b091aef6284737ae21ebdeb3cd0f0c, user_id=edeb113df9cd4e99925082eb2f48d85b, role_id=1b495dbb303447258ed6e7db6e67280f)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:08.217695 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:08.230225 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1440/2871] 10.222.0.48 () {60 vars in 1482 bytes} [Tue May 10 16:59:08 2022] PUT /identity/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c/users/edeb113df9cd4e99925082eb2f48d85b/roles/1b495dbb303447258ed6e7db6e67280f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 16:59:13.366112 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ebdd-4c71-4123-896f-85a30ec9887b None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:13.366704 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ebdd-4c71-4123-896f-85a30ec9887b None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:13.367000 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ebdd-4c71-4123-896f-85a30ec9887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:13.408614 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-67f1ebdd-4c71-4123-896f-85a30ec9887b None None] MFA Rules not processed for user `edeb113df9cd4e99925082eb2f48d85b`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:13.409838 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-67f1ebdd-4c71-4123-896f-85a30ec9887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:13.481325 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1432/2872] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:13.497867 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:13.500042 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:13.590770 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab7fe2-ef48-42fd-aa02-d5bdae2cb211 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:13.596388 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:13.597082 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:13.597361 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:13.597633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:13.676552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:13.678102 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:13.688878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1441/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 16:59:14.723235 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] REQUEST_METHOD: `POST` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:14.723712 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:14.723924 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:14.742064 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.auth.core [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] MFA Rules not processed for user `5fafb32dcef84cc7be2399905c2611c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:14.743265 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:14.750284 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1433/2874] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:42.078369 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:42.079839 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:42.095028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a4585-d311-457d-9ae6-7b5fb1c2e199 service nova] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:42.100964 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:42.101693 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:42.102003 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:42.102279 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:42.104086 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:42.117268 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:42.118885 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5bda1-8fe6-4f1e-ab8d-9c36c9cf1cee service nova] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:42.130190 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1442/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:43.934592 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:43.936017 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:43.991821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10025ee-8b2a-4bc2-ab1b-e07f7bca1163 None None] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:43.995411 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:43.996055 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:43.996370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:43.996653 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:44.005612 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:44.007042 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:44.016360 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1434/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:56.721814 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] REQUEST_METHOD: `POST` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:56.722376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:56.722376 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:56.740900 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.auth.core [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] MFA Rules not processed for user `fe1f5f6882eb4a9aa869ad32fbdb0d92`. Rule list: `[]` (Enabled: `True`). {{(pid=91914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 16:59:56.742788 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:56.794938 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1443/2877] 10.222.0.48 () {58 vars in 957 bytes} [Tue May 10 16:59:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 16:59:57.102913 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:57.111130 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145f50d-9a4d-44f9-a1d3-3313debb9e47 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:57.114662 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:57.115287 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:57.115565 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:57.115835 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:57.117875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:57.127058 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:57.128580 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:57.136870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1435/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 16:59:57.576327 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 16:59:57.577696 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:57.646266 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac853df-0168-450a-850f-0fa7b79a29a6 None None] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 16:59:57.651165 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 16:59:57.651805 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 16:59:57.652099 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 16:59:57.652393 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 16:59:57.654128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 16:59:57.665095 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 16:59:57.666654 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 16:59:57.676364 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1444/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:01:05.505585 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:05.507028 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:05.598095 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df316ba-30be-4b5e-baa8-b16f346e87c1 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:05.608416 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:05.609083 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:05.609365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:05.609641 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:05.611451 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:05.623616 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:05.625280 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:05.635656 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1436/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:01:43.978051 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:44.018209 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919fbae5-47f9-40ed-bdcd-6c4ef2783ae8 service placement] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:44.021989 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:44.022647 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:44.022932 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:44.023208 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:44.025177 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:44.037315 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:44.038780 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:44.049810 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1445/2881] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:01:54.416587 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:54.449554 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816da9d-5bdf-482e-a3da-91bb367f46c7 service placement] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:54.457370 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2c583bb342443e935446db4b26dcd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:54.457982 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:54.458211 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:54.458484 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:54.460667 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:54.491010 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:54.492755 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:54.504217 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1437/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:01:57.163557 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:57.177140 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b067cad-d8b0-41eb-b45d-30189bbb70ac service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:57.181237 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:57.181879 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:57.182638 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:57.182916 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:57.184835 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:57.209328 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:57.211170 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:57.223527 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1446/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:01:57.335244 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:57.347260 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e2623-9cc8-425e-8e70-cf412a478221 service nova] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:57.354720 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:57.357271 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:57.358163 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:57.358450 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:57.360651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:57.374681 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:57.376057 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:57.387870 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1438/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:01:59.302421 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:01:59.311471 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814c3e0-63df-445c-be94-67de66f7fcfd service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:01:59.315128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:01:59.315776 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:01:59.316059 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:01:59.316373 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:01:59.318231 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:01:59.410730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:01:59.412538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:01:59.433723 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1447/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:02:07.142363 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:02:07.144212 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:02:07.163153 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249a366-6bf1-4607-9881-090f6a8a1045 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:02:07.170551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:02:07.171600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:02:07.171705 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:02:07.171960 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] PATH_INFO: `/v3/users/fe1f5f6882eb4a9aa869ad32fbdb0d92` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:02:07.173404 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1f5f6882eb4a9aa869ad32fbdb0d92)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:02:07.176178 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:02:07.232368 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1f5f6882eb4a9aa869ad32fbdb0d92'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.249821 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1f5f6882eb4a9aa869ad32fbdb0d92'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.250573 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1f5f6882eb4a9aa869ad32fbdb0d92'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.251213 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1f5f6882eb4a9aa869ad32fbdb0d92'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.259039 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1f5f6882eb4a9aa869ad32fbdb0d92'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.272771 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1439/2886] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 17:02:07 2022] DELETE /identity/v3/users/fe1f5f6882eb4a9aa869ad32fbdb0d92 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:02:07.452028 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:02:07.462293 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25d7e-bc13-4a9a-a3a9-6a9fd5eebda4 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:02:07.520552 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:02:07.521413 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:02:07.521746 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:02:07.522020 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] PATH_INFO: `/v3/projects/0b8348f4bffd44e7b0da6367a1011709` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:02:07.523196 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8348f4bffd44e7b0da6367a1011709)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:02:07.525132 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:02:07.573765 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8348f4bffd44e7b0da6367a1011709', 'request_id': 'req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.579945 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8348f4bffd44e7b0da6367a1011709', 'request_id': 'req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.588203 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8348f4bffd44e7b0da6367a1011709', 'request_id': 'req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.600053 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] The token cache is being invalidate because project 0b8348f4bffd44e7b0da6367a1011709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:02:07.600378 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.601128 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.602702 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1448/2887] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 17:02:07 2022] DELETE /identity/v3/projects/0b8348f4bffd44e7b0da6367a1011709 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:02:07.606642 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:02:07.608156 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:02:07.621576 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1effc-2bec-496e-8d0b-4cbdb16c8bfa admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:02:07.678804 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:02:07.679947 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:02:07.680237 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:02:07.680537 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] PATH_INFO: `/v3/users/dc1a006afd24478ca2269d84f0ab38bf` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:02:07.681865 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1a006afd24478ca2269d84f0ab38bf)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:02:07.683896 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:02:07.736224 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1a006afd24478ca2269d84f0ab38bf'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.753262 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1a006afd24478ca2269d84f0ab38bf'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.754104 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1a006afd24478ca2269d84f0ab38bf'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.754814 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1a006afd24478ca2269d84f0ab38bf'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.762756 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1a006afd24478ca2269d84f0ab38bf'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:07.778073 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1440/2888] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 17:02:07 2022] DELETE /identity/v3/users/dc1a006afd24478ca2269d84f0ab38bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:02:07.966878 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:02:07.968490 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:02:07.984979 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3ae9-6b8e-4dd3-8b27-9296e0039209 admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:02:08.046753 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:02:08.047621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:02:08.047905 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:02:08.048182 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] PATH_INFO: `/v3/projects/5948d924e03b469c9368aeed17dd6ce3` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:02:08.049986 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5948d924e03b469c9368aeed17dd6ce3)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:02:08.051911 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:02:08.097541 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5948d924e03b469c9368aeed17dd6ce3', 'request_id': 'req-87a2bb04-9abc-4db1-a375-38bba172d5ba'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:08.103426 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5948d924e03b469c9368aeed17dd6ce3', 'request_id': 'req-87a2bb04-9abc-4db1-a375-38bba172d5ba'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:08.110730 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5948d924e03b469c9368aeed17dd6ce3', 'request_id': 'req-87a2bb04-9abc-4db1-a375-38bba172d5ba'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:08.121679 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] The token cache is being invalidate because project 5948d924e03b469c9368aeed17dd6ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:02:08.121969 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:08.122621 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:02:08.124166 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1449/2889] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 17:02:07 2022] DELETE /identity/v3/projects/5948d924e03b469c9368aeed17dd6ce3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:03:27.521925 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:27.523651 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:27.594020 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba9621-b019-462c-93fc-1df9e28e4ea5 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:27.658259 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:27.659408 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:27.659934 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:27.660476 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:27.663077 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:27.742059 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:27.744678 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:27.761685 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1441/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 17:03:28.957937 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:28.960888 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:28.976310 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2bb04-9abc-4db1-a375-38bba172d5ba admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:28.980303 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95bc0f08dd894e9c8edc4c90001f1844', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:28.981269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] REQUEST_METHOD: `GET` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:28.981269 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:28.981548 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:28.983544 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:28.998775 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:29.000512 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:29.013525 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1450/2891] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:03:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 17:03:38.636861 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:38.638365 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:38.713858 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e7b0-7be8-4001-92f9-6648b4340f83 service neutron] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:38.718878 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:38.719765 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:38.720052 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:38.720364 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] PATH_INFO: `/v3/users/5fafb32dcef84cc7be2399905c2611c1` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:38.721583 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fafb32dcef84cc7be2399905c2611c1)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:38.723679 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:38.774546 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fafb32dcef84cc7be2399905c2611c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:38.786742 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fafb32dcef84cc7be2399905c2611c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:38.787551 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fafb32dcef84cc7be2399905c2611c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:38.788172 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fafb32dcef84cc7be2399905c2611c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:38.794850 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fafb32dcef84cc7be2399905c2611c1'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:38.809945 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1442/2892] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 17:03:38 2022] DELETE /identity/v3/users/5fafb32dcef84cc7be2399905c2611c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:03:39.014958 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:39.029302 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592d06-28ee-4895-b290-cf88a04bb884 service neutron] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:39.094049 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:39.094921 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:39.095234 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:39.095480 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] PATH_INFO: `/v3/projects/4ca9807e934c4826bb948e391d7a315a` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:39.096906 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca9807e934c4826bb948e391d7a315a)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:39.099633 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:39.161395 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca9807e934c4826bb948e391d7a315a', 'request_id': 'req-0320104c-3580-46c9-a15c-b26db7f1dd1d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.167807 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca9807e934c4826bb948e391d7a315a', 'request_id': 'req-0320104c-3580-46c9-a15c-b26db7f1dd1d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.176191 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca9807e934c4826bb948e391d7a315a', 'request_id': 'req-0320104c-3580-46c9-a15c-b26db7f1dd1d'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.187434 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] The token cache is being invalidate because project 4ca9807e934c4826bb948e391d7a315a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:03:39.187718 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.188410 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.190249 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1451/2893] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 17:03:39 2022] DELETE /identity/v3/projects/4ca9807e934c4826bb948e391d7a315a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:03:39.195177 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:39.196905 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:39.216974 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf3bfc-fa0d-4e2c-9754-1a0059a403a2 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:39.279519 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:39.280312 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:39.280597 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:39.280875 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] PATH_INFO: `/v3/users/edeb113df9cd4e99925082eb2f48d85b` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:39.282098 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edeb113df9cd4e99925082eb2f48d85b)` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:39.284075 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:39.334221 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edeb113df9cd4e99925082eb2f48d85b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.345830 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edeb113df9cd4e99925082eb2f48d85b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.346600 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edeb113df9cd4e99925082eb2f48d85b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.347184 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edeb113df9cd4e99925082eb2f48d85b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.354764 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.notifications [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edeb113df9cd4e99925082eb2f48d85b'} {{(pid=91915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.369353 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1443/2894] 10.222.0.48 () {58 vars in 1223 bytes} [Tue May 10 17:03:39 2022] DELETE /identity/v3/users/edeb113df9cd4e99925082eb2f48d85b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 17:03:39.554075 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Authenticating user token {{(pid=91914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:03:39.556595 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.fernet_utils [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:03:39.577628 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320104c-3580-46c9-a15c-b26db7f1dd1d admin admin] Validating token access rules against request {{(pid=91914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:03:39.640538 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e2d8842c7d74786b278cdcd7a3dd77d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18061f9244ab48daafb61d27ac0a0610', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:03:39.641531 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:03:39.641817 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:03:39.642096 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] PATH_INFO: `/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c` {{(pid=91914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:03:39.643294 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b091aef6284737ae21ebdeb3cd0f0c)` {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:03:39.646193 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] RBAC: Authorization granted {{(pid=91914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:03:39.692578 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b091aef6284737ae21ebdeb3cd0f0c', 'request_id': 'req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.698819 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b091aef6284737ae21ebdeb3cd0f0c', 'request_id': 'req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.712427 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b091aef6284737ae21ebdeb3cd0f0c', 'request_id': 'req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15'} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.726451 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] The token cache is being invalidate because project 60b091aef6284737ae21ebdeb3cd0f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91914) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 17:03:39.726725 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.727390 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: DEBUG keystone.notifications [None req-c8ba94a7-4388-4b37-8da5-4bc9c8a79f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 17:03:39.729011 dv-cinder-835881-10-iscsi devstack@keystone.service[91914]: [pid: 91914|app: 0|req: 1452/2895] 10.222.0.48 () {58 vars in 1232 bytes} [Tue May 10 17:03:39 2022] DELETE /identity/v3/projects/60b091aef6284737ae21ebdeb3cd0f0c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 17:06:09.839786 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Authenticating user token {{(pid=91915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 17:06:09.841254 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:06:09.909113 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f707bf-adfc-4de1-b7ad-e98f17d239a7 admin admin] Validating token access rules against request {{(pid=91915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 17:06:09.966628 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8591023ac48f6af78ecb039dabb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '348ac1e53e7a49aca2621d3bb9538fe4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 17:06:09.967274 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] REQUEST_METHOD: `GET` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 17:06:09.967562 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] SCRIPT_NAME: `/identity` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 17:06:09.967842 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 17:06:09.969636 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.fernet_utils [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 17:06:09.980846 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 17:06:09.982438 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be092ed9-b388-49c9-9513-b081fedd270b service placement] RBAC: Authorization granted {{(pid=91915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 17:06:09.992286 dv-cinder-835881-10-iscsi devstack@keystone.service[91915]: [pid: 91915|app: 0|req: 1444/2896] 10.222.0.48 () {60 vars in 1365 bytes} [Tue May 10 17:06:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)